- Open Access
Barriers and facilitators to implementing measurement-based care for depression in Shanghai, China: a situational analysis
BMC Psychiatry volume 21, Article number: 430 (2021)
Measurement-based care (MBC) is an evidence-based practice for depression, but its use by clinicians remains low. Enhanced MBC (eMBC), which uses digital technologies, can help to facilitate the use of MBC by clinicians and patients. Understanding factors that act as barriers and drivers to the implementation of MBC and eMBC is important to support the design of implementation strategies, promoting uptake by clinicians and patients.
This situational analysis identifies barriers and facilitators to the implementation of standard and eMBC at mental health centers in Shanghai, China.
We used mixed methods to develop a comprehensive understanding of the factors influencing MBC and eMBC implementation in Shanghai. This study took place across three mental health centers in Shanghai. We used situational analysis tools to collect contextual information about the three centers, conducted surveys with n = 116 clinicians and n = 301 patients, conducted semi-structured interviews with n = 30 clinicians and six focus groups with a total of n = 19 patients. Surveys were analysed using descriptive statistics, and semi-structured interviews and focus groups were analysed using framework analysis.
Several potential barriers and facilitators to MBC and eMBC implementation were identified. Infrastructure, cost, attitudes and beliefs, and perceptions about feasibility and efficacy emerged as both challenges and drivers to MBC and eMBC implementation in Shanghai.
The results of this study will directly inform the design of an implementation strategy for MBC and eMBC in Shanghai, that will be tested via a randomized controlled trial. This study contributes to the emerging body of literature on MBC implementation and, to the best of our knowledge, is the first such study to take place in Asia. This study identifies several factors that are relevant to the equitable delivery of MBC, recognizing the need to explicitly address equity concerns in global mental health implementation research.
Introduction and background
Measurement-based care (MBC) represents a valuable, evidence-based practice (EBP) in the treatment of major depressive disorder (MDD). It is well demonstrated that the routine use of simple, validated depression outcome scales to guide clinical decision-making can improve patient clinical outcomes  and treatment adherence . However, despite policy-level recommendations for broad implementation of MBC , only a minority of clinicians avail of it [3, 4]. Barriers impeding the application of standard MBC in clinical practice include lack of clinician knowledge about appropriate scales to use, access to simple decision algorithms based on MBC, and time to administer scales. Health systems are also often not equipped to effectively track depression outcomes over time [3, 5].
Digital health technologies offer one compelling route to narrowing the MBC implementation gap . In the Canadian context, we have promoted the concept of enhanced MBC (eMBC), in which digital health tools are used to facilitate uptake of MBC in both clinicians and patients.
The utility of eMBC is demonstrated by increasing evidence in the North American context . While the impact of standard MBC has been illustrated in China , applications of eMBC in this context remain to be fully explored. This represents a key opportunity; over 54 million people experience depression in China , where MDD is the second-most commonly diagnosed disorder (after heart disease) and is estimated to cost 52 billion yuan (US$8.35 billion) annually . China’s mental health care resources have seen rapid development over the past three decades, but greater capacity is needed . Most of the mental health resources, including psychiatrists and psychiatric inpatient beds, are concentrated within the larger cities, leaving the vast suburban and rural regions with few services for mental health treatment, and most psychiatric services in China still primarily serve patients with psychotic disorders. Yet, there are also indicators to suggest that China is primed to scale up in the area of EBP. Many general hospitals have begun offering mental health services for patients with common mental disorders such as MDD. Chinese guidelines for the treatment of MDD have been recently revised and the National Mental Health Work Plan 2015–2020 specifies targets of improving the ability of healthcare facilities to identify depression and increasing the treatment rate by 50% . Shanghai, China’s most populous city, has relatively strong capacity for mental health service delivery, with care delivered at three levels ranging from the Shanghai Mental Health Center (SMHC), a tertiary hospital, to district mental health centers and neighbourhood clinics. Initial steps to implement standard MBC have been undertaken in Shanghai and conditions, such as the use of electronic medical records (EMR) in many mental health centers, indicate considerable promise for adoption of eMBC across Shanghai’s mental health system. The development of an effective implementation strategy to promote the uptake and scale-up of MBC, however, requires a thorough understanding of the context of the use and delivery of depression services in Shanghai.
While evidence of the effectiveness of mental health interventions globally has increased in the last decade, there remains a gap in uptake and scale-up of EBP. To address this gap, implementation science is increasingly employed in the field of global mental health (GMH). Situational analyses are a critical first step in implementation science for GMH, as they provide a thorough and nuanced understanding of the complex context of delivery [13, 14], allowing for the development of targeted implementation strategies. Health equity considerations lie at the heart of GMH . Approaches to GMH implementation research that include equity as a key consideration  are required to fully address current inequities in mental health service delivery and access. However, our recent scoping review of methodological approaches to situational analysis in GMH identified that minimal attention is given to health equity considerations . Situational analyses provide an opportunity to identify, and subsequently to ameliorate, equity gaps to ensure implementation strategies can be tailored to promote equitable access to care.
The Enhanced Measurement-Based Care Effectiveness for Depression: A Canada-China Implementation Project (EMBED) was designed to develop a novel EBP implementation strategy by adapting, implementing and evaluating eMBC in diverse community mental health centers in Shanghai, China, modeled on programs implemented in Canada. EMBED addresses 4 broad aims: 1) identify contextual enablers & barriers to MBC implementation; 2) explore physician- and patient-level factors as mediators for an EBP implementation; 3) provide clinical and health economic outcomes to establish effectiveness of eMBC; and 4) build knowledge and capacity for scale up of eMBC in China and beyond. This formative study address the first two objectives by providing an in-depth situational analysis of the context of implementation of MBC and eMBC in Shanghai, China. The results of the situational analysis will inform the EMBED implementation strategy, which will be tested in a randomized controlled trial (RCT).
This Situational Analysis used mixed methods to develop a comprehensive understanding of the implementation context for MBC and eMBC in Shanghai mental health centers (MHCs). Mixed methods can help to mitigate the challenges of data collection including low availability of health system data , provide a deeper contextual understanding and increase validity of results . Specifically, three methods of data collection were used to triangulate data and ensure a comprehensive understanding of the implementation context: situational analysis tools, quantitative methods and qualitative methods.
Primary data collection took place in Shanghai, China between February and August 2019 at three mental health centers. Data were collected by members of the Shanghai research team with support from Canadian team members.
Situational analysis tools
We developed a situational analysis (SA) tool, administered to collect data at each of the three study health centers. Shanghai Mental Health Center (SMHC) is a large, tertiary mental health and teaching hospital and is a WHO Collaborating Center. Hongkou Mental Health Center (HKMC) is a community mental health center located in the Hongkou district of central Shanghai, while Fengxian Mental Health Center (FXMC) is a community mental health center located in the suburban district of Fengxian. The SA tool was used to collect current information on coverage and service provision, workflow and readiness for MBC implementation and to capture variation between study sites, based on reports from MHC staff and internal reporting systems. The SA tool was completed by members of the Chinese study team between November 2018 and April 2019.
Online surveys were conducted with two groups of participants, clinicians and patients, at the three MHCs between February and July 2019. To be eligible, clinician participants were required to be employed at one of the three centers and to provide informed consent. The clinician surveys included components assessing knowledge and beliefs about MBC, current practice related to use of MBC, perceived feasibility of using MBC, acceptability of eMBC, demographics and work-flow. The questions related to acceptability of eMBC were preceded by a short vignette that described the use of eMBC in a clinical setting.
Patient participants were required to have previously received a diagnosis of depression, to be between the ages of 18–65 years, to have sufficient literacy to complete the survey, and to provide informed consent. The patient survey included components assessing the use of Internet and mobile technology, the use of the Internet for health information and support, MBC and eMBC acceptability, and demographic information. The sections on MBC and eMBC acceptability were preceded by brief vignettes describing the use of MBC and eMBC in a clinical setting. Clinician surveys were distributed via private WeChat groups at each health center, with a quick response (QR) code to scan to access the survey. Patients were informed of the online survey by their clinician. Participants were asked to provide informed consent and were unable to proceed with the survey without doing so.
Qualitative data collection occurred via semi-structured interviews with clinicians (n = 30) to understand their current knowledge and practice related to MBC and barriers and drivers to the use of MBC and eMBC. Six focus groups were conducted with patients at the three mental health centers, with two at each center. Focus groups were stratified by age (under and over 45 years), as age was considered a potential factor affecting uptake and use of digital technologies. The interviews and focus groups were conducted by members of the Shanghai research team, digitally recorded and transcribed in Mandarin by the Shanghai team. De-identified transcripts were then transferred to the Canadian team via a secure data transfer system, after which they were transcribed into English by two bilingual research assistants.
The results of the surveys were analysed by SPSS using summary statistics disaggregated by MHC location and age and gender of clinicians and patients.
Interviews and focus groups were analysed (by JM and EM) using a framework analysis approach, which is commonly used in health systems research to identify barriers and drivers , using NVivo 11 software . Although data collection and analysis often occur concurrently in qualitative traditions, this was not fully feasible in this project due to the time lag for interview/focus group translations. JM and EM independently coded 6 clinician interviews and one patient focus group before meeting to develop the initial coding framework. A series of meetings then occurred to iteratively discuss and monitor coding consistency and to address the analytic validity of identified themes. A written description of the derived themes were then sent to the Shanghai team in order for them to comment on interpretations.
Coverage, uptake and service provision
Shanghai’s community MHCs operate on a catchment basis, with HKMC serving a population of 0.8 million and FXMC serving an area of 1.2 million. SMHC offers mental health services to the population of Shanghai, covering 24 million people. In 2017, HKMC saw 1066 patients per month, 410 of whom were inpatients, FXMC saw 2376 (22 inpatients) and SMHC saw 858,900 (6681 inpatients). Regarding patients accessing care for depression, in 2017 3824 accessed care at HKMC, 797 at FXMC and 40,527 at SMHC. All MHCs provide inpatient and outpatient care, and a variety of individual and group psychosocial therapies. HKMC also provides access to peer support programs. Both HKMC and FXMC have a partnership with a program (Yangguang Xinyuan) run by the Shanghai Federation of Disabled Persons, which provides community programs for people in recovery from severe depression. SMHC offers more extensive programs for inpatients (e.g. art and music therapy, occupational therapy, Morita treatment) and outpatients (cognitive behavioural therapy, social skills development, self-management and behavioural activation, music and art therapy, etc.)
100% of psychotropic medicines can be purchased at MHC pharmacies, with cost varying substantially by type of medication. HKMC and FXMC report that the average cost of medications per patient is approximately 1200 RMB (172 USD) for 6 months, while SMHC reports the average cost for the same time period as 3600 RMB (516 USD). FXMC and HKMC patients may access up to 5000 RMB per year via support by the Federation of Disabled Persons and the “Free Drug Delivery to the Countryside” program. All MHCs report that almost all patients have some insurance coverage, which may vary by type and amount of coverage for prescription medications. Therefore, while psychotropic medications are widely available, the type of medication prescribed may be influenced by cost and ability to pay.
Management and supervision at MHCs takes place on several levels. Internal departmental supervision includes intradepartmental reporting and follow-up on any areas requiring improvement. Supervision also takes place between departments, with interdepartmental recommendations to address challenges or problems. Finally, a number of higher authorities, including the Health Supervision Office, the District Health Planning Committee, the Medical Records Quality Control Committee, the Medical Insurance Office and the Price Control and Management Office conduct both regular supervision and random inspections.
Understanding workflow across the mental health centers is useful for understanding how MBC might be administered in practice and for planning for MBC protocols. The processes of registration, intake, assessment and referral are fairly standard across all three health centers. Because SMHC is the top tier mental health hospital in Shanghai, patients with complex treatment requirements or whose families prefer more specialized care might be referred there by HKMC and FXMC. Patients generally have a choice of physicians based on physician profiles (posted in the outpatient hallway, on the MHC’s website and on the official WeChat channel of the MHC), recommendations by nurses or other intake staff, or recommendations by friends or family members. Diverse staff are involved in initial intake, appointments and follow up visits, including intake nurses, psychiatrists, psychometricians, and pharmacists. There is some variation in booking processes, with SMHC offering online and app-based options (e.g. WeChat, Alipay, guahao.com), while HKMC and FXMC have a phone or in-person booking system with appointment records stored on health center computers. Patients visiting all MHCs have the option to pre-book or drop in. Patients can also choose their preferred clinician both initially and for follow-up appointments. In the case of HKMC, patients will only see the same clinician during follow-up by request, meaning that they often see a different clinician during initial and follow-up appointments. At FXMC, patients will generally see the same clinician at each visit unless they request a different physician. Wait times for appointments range between half an hour and 2 hours across all centers, and are unaffected by ability to pay. While SMHC and HKMC use EMR, FXMC uses EMR for inpatients but paper records for outpatients.
Readiness for MBC implementation
At SMHC and HKMC electronic medical records are used and are shared within each hospital. FXMC uses paper patient records for outpatients and electronic prescriptions and uses electronic records for inpatients. Patients at all MHCs will receive a paper copy of their patient record following their appointment or discharge from an inpatient ward. Standards for keeping patient records are in place across Shanghai and are outlined in the Shanghai Mental Health Clinical Quality Control Manual. SMHC indicates that they have a dedicated staff person providing oversight for quality of patient records. Computers are available at all centers to all clinicians and Internet access is available across all MHC’s but may be inconsistent at FXMC, the suburban center, which uses a LAN connection that can be unreliable. Standardized measures are available both on paper and online at each MHC and are currently administered only by psychometricians. Commonly used measures include the Zung Self-Rating Depression and Anxiety Scales , Symptom Checklist (SCL)-90 , the Minnesota Multiphasic Personality Inventory (MMPI) , Eysenck’s personality questionnair(EPQ), and the Hamilton Depression Rating Scale (HAMD) .
Survey and qualitative data
Below, survey and qualitative data results are presented for the clinician and patient groups. Emergent themes from the qualitative data are supported by direct quotes.
Mixed methods results: clinicians
A total of N = 116 clinicians completed the online survey (SMHC n = 78, HKMC n = 23, FXMC n = 15). Demographic information, qualifications and workload are described in Table 1:
Though all survey participants indicated that they are psychiatrists, their highest degree of qualification varied. This is likely related to the change in training requirements over time, as prior to 2000 it was possible to work as a psychiatrist without a Bachelor’s degree (subsequently, training requirements have become more stringent). Primary context of work varied across MHCs. At SMHC, 35.9% of surveyed clinicians work in an outpatient center (OPC), 11.5% in an inpatient unit (IPU) and 44.9% in both, at HKMC, 17.4% work in an OPC, 47.8% in an IPU and 30.4% in both, while at FXMC 100% of surveyed clinicians work in an IPU. Surveyed clinicians were fairly experienced, with 23.3% having spent between 6 and 10 years, 24.1% 11–15 years, 24.1% 16–20 years, and 23.3% over 20 years in practice. FXMC’s clinicians were somewhat newer to their jobs, with 40% indicating they has been working for 6–10 years, while at SMHC 28.2% have been working for over 20 years. Shanghai clinicians spend a substantial amount of time in patient care, with 30.2% spending 30–40 h per week and 22.4% spending over 40 h per week, though clinicians at FXMC reported less time with patients compared with SMHC and HKMC. Numbers of patients per week was also lower at FXMC, as shown in Table 1. Clinicians at SMHC saw the highest volumes of patients per week. A majority of clinicians surveyed (55.2%) specialized in general psychiatry, with 73.3% at FXMC selecting this as their specialization. The other most common categories of specialization are mood disorders (19.8%) and clinical psychology (10.3%).
Current practice related to MBC
Through surveys and interviews we assessed clinicians’ current practice related to MBC, including how they currently assess changes in a patient’s condition, medication side effects and functional ability, and their current knowledge about MBC. Surveyed clinicians were asked to rate their level of agreement on questions related to their current practice in terms of MBC use, as described in Table 2:
Survey responses on current practice with MBC varied, with clinicians across mental health centers indicating a high level of agreement regarding the importance of MBC, their knowledge about interpreting MBC scores, and the importance of discussing MBC results with patients, as shown in Table 2. Reported levels of training in the use of MBC varied considerably, with 24.1% of total clinicians surveyed indicating they disagree that they are trained in the use of MBC for clinical decision making, while 37.1% indicated that they agree to being sufficiently trained. While responses from SMHC and HKMC were similar, a higher proportion of FXMC clinicians indicated they were sufficiently trained, with 66.7% agreeing.
Survey results were variable in terms of their use of MBC at each visit. 19.8% of clinicians disagree and 20.7% somewhat disagreed that they used MBC at each visit, while 30.2% somewhat agreed and 22.4% agreed. Notably 73.3% of FXMC clinicians, compared with 14.1% at SMHC and 14.5% at HKMC agreed that they use MBC at each visit. This is consistent with the results of qualitative interviews, where descriptions of use of standardized assessment scales as part of routine clinical care varied highly by center. At SMHC measures were typically only applied during initial consults; administration of depression scales over time to monitor response to treatment or longitudinally track outcomes was uncommon.
At HKMC and FXMC descriptions of use of outcome measures in the initial appointment or subsequently to assess changes in a patients’ depression severity, treatment side effects or functioning varied. While some described using measures, a majority stated that they are used occasionally or not at all. For example, a clinician from FXMC stated that: “for some patients, we’ll ask them to do some measures, but very seldom”. (FX01).
Others described using it occasionally on inpatient wards but never in outpatient clinics. Some clinicians described measures being used more frequently during initial visits but not during subsequent appointments:
“We also use the standardized outcome measures often. More frequently we use them in the initial assessments or when there are changes of medical conditions. Generally speaking, we do not use them for every regular visit. Especially when the medical condition is quite stable, measures are seldom used” (HK05)
Patient report was the most commonly referred to approach to assessing changes in depression severity as shown in the following quote:
“According to my clinical experience, then I will listen to his main complaints, includ(ing) observing some of his external performances, such as expression, tone of voice”. (SH03)
Family report of a patient’s condition was also frequently described as a means of assessing changes in depression severity, as described by a clinician from Fengxian:
“When patients come to the visits, I’d ask about their status at home, including sleep, eating, work, and relationships with their family, as well as mood changes. After that, I’ll ask their family to add some medical conditions.” (FX06)
A clinician from Hongkou stated that they assess changes in a patient’s condition “from the information provided by people surround[ing] that patient” (HK10) while a SMHC clinician stated that “[c]ollected information is mainly from their family” (SH08).
Some clinicians did describe using measures, though they were in the minority. A clinician from Hongkou MHC described: “The patient’s condition changes can be assess(ed) through some measures, such as the Hamilton Depression Scale, etc., we can see whether his condition has changed, whether it is improved or worsened”. (HK08).
When measures were utilised, they were on occasion described as being “auxiliary” (SH07) or “correlative” (SH01).
A majority of clinicians interviewed also described using patient report or family feedback to assess the impact of side effects:
“Mainly based on the information provided by patients or their families after they take the medications, as well as patients’ own feelings/experience”. (SH02)
Several clinicians described the use of measures to assess side effects, but did not describe their use as part of their routine clinical practice:
“First, we’ll focus on their main complaints. When they come, they’ll tell you some current symptoms. If they do not mention these actively, then we’ll ask them whether they have some physical discomforts or not, and ask them to think about whether these are related to the meds. If necessary, we’ll also do some measures.” (FX09)
One respondent from Fengxian described using measures to assess side effects in approximately one of 10 patients.
In terms of assessing improvements in patients’ functional ability, the majority of clinicians again described patient and family report as the most common means of assessment:
“We usually ask about patients’ (abilities) such as work ability, as well as their general symptoms, but the most important thing is to ask their family, because some depression patients may have a different self-assessment of their abilities. Hence, we mainly ask their families, about their general daily performance at home, as well as work ability, etc.” (FX06)
Three clinicians described using measures to assess functional ability, but using functional measures was not common practice, for example:
“ [We can] identify the changes by measurement assessment. Such as the functional ability measure that we have now.” (HK03) and “Clinicians will assess the patient from some social function measures as well” (SH01)
Knowledge and beliefs about MBC
Clinicians were also asked to respond to survey questions about their knowledge and beliefs about MBC, as described in Table 3.
Clinician responses to all questions related to knowledge and beliefs about MBC showed positive attitudes, with a high level of agreement regarding the validity and reliability of standardized measures, the positive impact of MBC for treatment decision-making, monitoring treatment response, patient education, patient engagement in decision-making and consistency of care across providers.
Qualitative interviews explored clinicians’ existing knowledge about MBC. Familiarity with MBC varied across health centers, with a majority at SMHC stating that they are familiar with it while at HKMC and FXMC there was more variability. Some provided definitions of it, stating that MBC is more objective and standardized, allowing for tailored treatment decisions. One clinician from Fengxian stated: “I think if it’s measurement-based care, the treatment will be more standardized. That’s my understanding” (FX04). A clinician from Hongkou gave the following description:
“It may be relatively more standard or systematic, so it may be relatively comprehensive. It’s more standardized, not just the doctors’ feelings, right? If so (based on doctors’ feelings only), there might be some deviations. Through regular assessments, we can have a comprehensive evaluation, and it will also help us to have an overall idea of their medical conditions.” (HK01)
Another interviewee from SMHC provided a definition that described how the comprehensive nature of MBC might benefit treatment decision-making:
“MBC is not just about evaluating patient’s symptoms every time, but also identifying side effects, which is the most basic process…At first, we need to identify the efficacy and the side effects. Then measure the risk-benefit ratio between the two. So as to determine what kind of further treatment plan the clinician will use, like whether to increase or reduce medicine. Although MBC is somehow subjective, it is relatively more objective according to our clinical experience”. (SH03)
Others noted that they have heard of MBC but are unfamiliar with its meaning, or that they have not heard of it at all: “Based on measurement? Since I’m in the geriatric psychiatry department, I’m not familiar with that” (FX08) or that they had received training on MBC but not absorbed it fully: “There seemed to have (been) some training in our hospital, but I didn’t pay too much attention to it”. (HK07).
Despite the survey results suggesting positive attitudes towards MBC, interviewed clinicians identified several perceived barriers to them using it in their current practice. They identified time constraints as a main barrier, as seen in the following quote from a clinician in Fengxian:
“Now, there should be measures, measures for depression, but in outpatient clinics, sometimes time is limited, so (we are) unable to do the measures.” (FX02)
Clinicians from HKMC and SMHC expressed the same concerns: “But there are difficulties in the clinical practice, that is, there is not too much time for doing this” (HK07) and “There is no time to do it. Time is a big problem”. (SH07).
There was also a concern that using MBC would require more time allocated to patient consultations:
“The more information you let patients know, the more questions they will have and the more time you need to spend for explanation. Hence the first thing is that we need time”. (SH08)
Clinicians also suggest that their patients might be reluctant to complete measures due to their own time limitations or general reluctance to do so:
“If the questionnaire is too long, the patient seems to have no patience with it”. (HK07)
Some clinicians also question the accuracy of measures and the ability of patients to accurately self-report, as they believe that patients might be unable to give an “objective” response:
“...there's a huge difference between different individuals, and the scales are based on patients’ own feelings. They will fill out as what they believe their medical conditions are (which may not be the reality). Their feelings might not be very objective. Hence, the measures may not be very accurate.” (FX07)
Other factors identified include the belief that measures are unavailable, as stated by this clinician from Hongkou: “You mentioned the standardized outcome measure. In my knowledge and current practice, this measure has not been used, nor have I noticed it” (HK02).
And, more specifically, concerns about lack of availability of appropriately adapted measures:
“Different measurement tools can cause problems. If some of them are imported and translated into Chinese, they may not fit into [our] native culture”. (SH03)
Several drivers related to clinicians’ beliefs about MBC also emerged during qualitative interviews. Improved patient empowerment, awareness about their illness and improved treatment alliance were described as potential benefits by clinicians. A clinician from Fengxian stated:
“I think if it’s me, I’d be willing to use such an assessment, because in this way the doctors and patients will be in an equal status, and doctors will fully respect patients. Patients will have the right to know about their entire treatments. It’s about the informed consent. At least they know about their own disease better, which would benefit the following treatments.” (FX04)
A clinician from Hongkou also stated: “It also has the advantage of giving patients a more complete understanding of their condition, that is, letting the patient have a comprehensive understanding of himself” (HK10).
Clinicians also noted that MBC could help to improve treatment adherence by involving patients more actively in their treatment decision-making and helping to increase their awareness about symptom changes that might go unnoticed without the systematic use of scales. “I think the biggest benefit would be improved medical adherence, because they get involved”. (HK06).
A Hongkou clinician described the potential for MBC to ultimately improve hope about treatment effectiveness and adherence among patients:
“It will make it easier to identify the aspects of their improvements, and pay attention to those improvements as well instead of focusing on the unimproved ones. In this way, patients will become more faithful, which is helpful as well.” (HK01)
A SMHC clinician similarly described the potential positive impact of seeing an objective improvement in outcomes on patient morale: “In fact, many patients, for example, did not have a big change in the treatment of nearly two weeks, but if he pass this score, he will gain some confidence”. (SH01).
Feasibility and perceived barriers and facilitators of use of MBC
Clinicians were asked to rate their level of agreement on questions related to the feasibility of using MBC, as described in Table 4:
Regarding perceived feasibility of MBC, most surveyed clinicians agreed that they would use MBC if provided with proper training and resources, that they would use MBC to evaluate their own practice, and that they would be more likely to use MBC if it was automated or delivered via an electronic platform. The belief that electronic delivery would promote feasibility was also reflected in the qualitative interviews. A clinician from Fengxian center stated:
“...it’s like more electronic and more easy, convenient. Better to have records saved, that can be accessed at any time, which may be more convenient to both doctors and patients. Also the records need to be improved, better to have some curve figure to show the results to make it more straightforward.” (FX07)
Clinicians noted that using paper measures with standard MBC might be burdensome but that electronic delivery might help to simplify and streamline the process:
“I don't necessarily have time to do the measures. If I have to do a self-rating scale, it is not convenient as well. Because I need to give the measures in paper to the patient and he might have to record the result in the computer at the end, and the workload would be a little bit heavy” (HK09).
Perspectives among surveyed clinicians regarding the perceived willingness of their patients to complete measures were varied, as described in Table 4. Patient willingness and capacity emerged from the clinician interviews as a potential barrier to MBC implementation. As stated by clinicians from Fengxian and Hongkou:
“...the biggest challenge is that patients may not be willing to collaborate, not willing to do it” (FX05).
“I think that patients should be able to accept it first. For example, it would be easily accepted in the inpatient ward. However in the outpatient clinics, there are many patients, they will not have enough patience for everyone doing the MBC” (HK08)
Additional potential barriers were also raised:
“Literacy level, age, and other factors need to be suitable for completing the measures” (FX01)
Clinicians also expressed concern that depression symptoms, particularly among patients with severe depression, would affect their ability to complete the measures. They stated that measures must be simple, relatively brief and easy to understand.
“Then there are some patients who may be resistant to the measure because of their illness. Since the patient is depressed, he is not interested in anything, he is not willing to touch anything, so that maybe creates a little problem when using the measures”. (HK07)
Regarding whether MBC would be easy to integrate into their current workflow, a majority agree, as shown in Table 4, however disagreement is somewhat higher among SMHC clinicians. In qualitative interviews, workload and workflow emerged as potential barriers to MBC implementation. Clinicians from all MHCs identified time and number of patients as a major feasibility barrier:
“...if [we] compare the MBC with our usual outpatient clinic, the clinician may not have enough time to meet with all the patients if they all used MBC, since we have roughly 40 to 50 patients in one single morning. MBC requires evaluating the patient and discussing with the patient his condition change, which is time consuming.” (HK02)
Three people mentioned concern with patients having to pay out of pocket for measures, such as this interviewee from SMHC:
“At present, we mainly use some measures that needed to be charged. During the follow-up appointment, most of the patients will consider the measures useless. “I don’t have to spend this money, I am already recovered” (SH01).
Several strategies were recommended that might mitigate feasibility barriers, including those related to workflow and time. Some clinicians suggested allocating a designated staff person, such as a nurse or receptionist, to assist patients with measures as they perceived the demand would be too onerous for psychiatrists. They also suggested that a team-based approach that would facilitate MBC implementation should be mandated by management. Booking appointments specifically dedicated to MBC was suggested as a means of improving feasibility. These mechanisms to support MBC delivery are reflected in the following quote:
“One [thing that is needed] is policy support. Personnel needs to be arranged. When patients come here, before seeing patients, someone needs to take them to do the measures, right? Communicate with doctors. Or the nurses or social workers can see the patients first, and send the completed measures to doctors. That’s good, I think. It needs a specific person to get it done, before the medical appointment.” (HK04)
Separate rooms for patients to complete the measures were also recommended. A clinician from Hongkou stated:
“…It is better to have a private, independent and quiet environment, so that the clinician can have a more detailed communication with the patient. This enables patients to make an objective assessment without reservation,” (HK03)
Another clinician from SMHC reflected that this would be easier to implement in major urban hospital settings:
“We can do this here, but I don't know if we can still do it elsewhere, because there is no psychological measurement room or assessors in the minor cities” (SH05)
Acceptability and perceived barriers and facilitators to use of enhanced MBC (eMBC)
Subsequent to asking about the use of standard MBC, we asked clinicians to rate their level of agreement about the acceptability of using eMBC based on a brief vignette describing the use of eMBC in a clinical setting. Responses are described in Table 5:
Qualitative interview results provided further information on clinicians’ views of the potential positive and negative effects that eMBC could have on patient care.
Many clinicians stated that they believe eMBC would be more comprehensive, efficient and convenient than current practice. eMBC could improve treatment plans for patients and improve symptom tracking. A clinician from Hongkou stated:
“In this way, it’ll save doctors some time. Doctors can have deeper communication with patients on some highlights of their issues. Based on the assessments results, we may skip some unimportant things, and avoid some ineffective consultation.” (HK01)
Clinicians also acknowledged that eMBC would help to avoid some of the challenges identified in relation to standard MBC. A clinician from Fengxian stated:
“It’s also mobile and portable, and hence the tool itself is very convenient to patients. Patients may complete when they have time, and they do not have to do it during their wait for the appointments. Hence its usability and accessibility is very good”. (SH09)
Additionally, clinicians believed that there are multiple ways in which eMBC could improve patients’ engagement with and adherence to treatment. Firstly, using the patient’s input as a valuable part of the treatment plan can strengthen the therapeutic alliance:
“I think it’d be that patients’ feelings would be better respected in this way, so that there’d be a better relationship with patients and doctors. Their adherence to medications and treatments may be improved” (FX09)
With improved patient-clinician understanding, the clinician can offer a more holistic and individualized perspective on the patient’s experiences and priorities regarding treatment, as stated by clinician from Hongkou and SMHCs:
“I think it’s more targeted. And it’ll be easier for us to understand patients, such as what treatments they prefer, or which issues they are more concerned with and want to solve first. When we make decisions, we’ll pay more attention to these things” (HK05).
“There is definitely benefits. ...Lot of studies had confirmed that the treatment of depression will be better if the doctor's treatment plan is in line with the patient's own wishes”. (SH 03)
Clinicians also noted that a patient’s enhanced understanding of their condition could also provide positive effects including stigma reduction:
“In the process, there is not only an assessment, but also health education and the understanding of disease knowledge, which can help patients to eliminate fear and shame of depression. Then they can find out from the assessment which aspects have a more positive change, thus accumulating confidence in the treatment” (SH10)
Though clinicians believed eMBC offers many avenues to improve patient care, some also spoke to the importance of contextualizing eMBC results with other forms of clinical data and processes:
“The measurement in MBC should be comprehensive, including the psychiatric exams, i.e. doctor’s assessment, feedback from families, etc. All these together are called measurement-based. If it’s only based on self-report, I don’t think it’s measurement-based. It’s just one-sided. Hence, measurement-based care is good, but if you only use this one tool, there must be bias”. (SH08)
Additionally, they noted that eMBC should not be viewed as a replacement for usual clinical contact:
“Of course, no assessments/measures can replace the actual communication between doctors and patients, including collecting information such as their body language, tone, or even their smell, etc., which cannot be assessed by the paper or mobile measures/scales. Hence, (the measures/scales) as a supplement” (SH09)
Although clinicians showed a high level of agreement about their willingness to use eMBC and their perception that it would make MBC easier to use, they also identified several potential barriers. A clinician from Fengxian questioned how the formality of a typical consultation would be maintained as clinicians and patients communicate within an app:
“However in fact, we still hope to provide formal diagnosis, formal treatments and formal suggestions in the medical authorities, which have better qualifications for medical practice, instead of providing some suggestions in the chats. The patients may consider those chats as doctors’ instructions, which may be not formal.” (FX09)
Some saw enhancing the role of patients in treatment decision-making as a threat to the status quo where the clinician’s knowledge is unquestioned:
“What he considers the treatments may sometimes contradict to our medical knowledge. He will apply those treatment strategies, and thinks that this is what he needs most. In fact, this is not the best strategy. This is a challenge”. (HK09)
“I don’t like it. I feel that if you let patients to use the mobile phone by themselves, then their trust for doctors will go down. They’ll feel you are not useful, and they are completing all things by themselves”. (HK06)
Clinicians also questioned patients’ capacity to complete self-report measures as a consequence of depressive symptoms, including low motivation, functional ability and cognitive impairment. One Hongkou clinician stated:
“There is no big challenge for clinicians, I can use cell phone apps, and be able to see the patients’ scores. I don't think there is any big challenge for me. But for the patient, the challenge is that once his condition worsens and there is severe depression, it may not be possible to complete the eMBC”. (HK02)
Others questioned the benefits of enhancing patient knowledge about depression and treatment options:
“For example, some anti-depressants may have some side effects. If you tell them about these side effects, patients may have some concerns. Another thing is that if patients know too much about their medical conditions, it will affect their moods?” (FX06)
A clinician for SMHC states: “I mean, sometimes it may not be good for them to know too much”. (SH06).
In interviews, clinicians also raised several concerns about the ability of patients to accurately complete measures delivered via an app. This included the possibility that a patients’ family might complete the measures on their behalf, meaning that the results might not accurately reflect the patient’s condition.
“They may randomly choose an answer, which is meaningless. That’s why self-report should be used together with administered report. Self-report is not always totally reliable, and it can just be used as a reference. At the beginning, they may take it serious, and do it carefully, but after a while, they become unwilling to do it”. (SH08)
Similarly to standard MBC, clinicians also raised concerns about workload. They worried that eMBC would require more explanation and would generate more questions from patients that would infringe on clinicians’ time:
“I think it’s time consuming to let patients scan the QR code, and the process… to download this thing using the QR code to explain it.. I mean, the work of explaining it to clinical patients, and to promote/implement it, would be a challenge”. (SH02)
Some also questioned whether the nature of eMBC and the use of mobile apps would impinge on their personal time, requiring them to engage with patients outside of regular clinic hours:
“... if it’s like Wechat and when the patients add you on it, they might occupy your personal time (for consultation). I think the word “occupy” in this situation is appropriate.” (FX03)
Literacy, including digital and health literacy, was identified as a potential barrier, especially for seniors, people with lower levels of formal education, people with disabilities or people living in rural or remote areas:
“Some seniors may not know how to use a mobile phone, and another [challenge] is that if their literacy level is not high enough, they may not understand it, or may not understand some questions, right?” (FX02)
One interviewee also spoke to concerns about physician capacity to utilize apps, although there was no variation in responses about eMBC acceptability by age group among surveyed clinicians:
“For some older clinicians, the challenges might be such as the application of the mobile phone is not familiar which makes them unable to use it” (HK09)
Clinicians also believed that privacy and security considerations might deter patients from using eMBC:
“I think the issue for this kind of tool is data confidentiality. For patients’ privacy, they may have concerns about who has the access to data and who will know their information, what this information will be used for”. (SH09)
In addition to reporting the perceived positive and negative considerations for implementing eMBC, several clinicians also spoke to their perceptions of system-level facilitators for eMBC, including the need for marketing and promotion of the intervention:
“There must be publicity for the two treatments since not everyone can accept these care right away. The treatments are very good but not every good thing can be accepted by everyone. Therefore, publicity is important so as to let the patients and the clinicians better understand the treatment methods. What do MBC/eMBC mean to the treatment? What outcomes will they bring to the clinical practice? What are the difference between the two? The clinician and the patient need to accept MBC and eMBC from the bottom of their heart so that it is easier to implement and market in the clinical practice”. (HK08)
Provision of training for both patients and clinicians was seen as essential, as described by a clinician from Hongkou, who stated:
“For initial visits, we can arrange specific staff to provide health education (for clinicians) including training on measures. Professional assistance is needed to do it” and “I think for the first time using the measures, there should be some health education to make sure patients can understand the terms correctly”. (HK06)
Mixed methods results: patients
We surveyed and conducted focus groups with patients to assess and understand their current use of Internet and mobile technology, their use of the Internet for health information and support, and the acceptability of standard and eMBC. N = 301 patients responded to an online survey (SMHC n = 151, HKMC n = 88, FXMC n = 62). We conducted six focus groups and stratified by age (18–44 years and 45 years and over) at FXMC and HKMC. Two focus groups of mixed ages were held at SMHC, with n = 4 and n = 2 participants in each. At FXMC, n = 3 people participated in the younger group and n = 2 people in the older group, while at HKMC there were n = 4 in the older and n = 4 in the younger group.
Demographic information for patient survey respondents is displayed in Table 6:
There is variation in the age of patient respondents between SMHC, where a majority (65.6%) are under 30 years old, and at the other two health centers where patients respondents are much older. The predominance of younger participants from SMHC may be due to the nature of the hospital, as it is one of the top tier psychiatric hospitals in China and attracts patients from across the country, many of whom are young. Younger patients may also be more willing to complete an online survey. At HKMC, 63.7% of respondents are between 50 and 69 years, and at FXMC 50% are between 50 and 69 years. The majority of respondents (72.4%) across all health centers are female, which is consistent with patient demographics at all centers. Though a majority (78.4%) are Shanghai residents, 21.6% indicate that they are not, and have likely traveled to Shanghai from elsewhere for mental health services. A majority of patients are educated at the high school (27.2%) or undergraduate (34.6) level, though in Hongkou and Fengxian 30.7 and 27.4% respectively report high school as their highest level of educational attainment. The majority of patient respondents are currently employed full-time (33.6%), retired (30.6%) or students (18.3%), with the highest number (68.2%) of retirees in Hongkou district and the highest number of students (32.5%) among SMHC respondents.
Patient use of internet and Mobile technology
We asked patients to respond to survey questions about their current use of the Internet and mobile technology, as displayed in Table 7:
A majority (82.1%) of patient respondents across all MHCs indicate that they use a smartphone many times a day, however it is notable that among respondents from FXMC 21.0% indicated that they use one rarely or not at all. 94.4% of patient respondents own a smartphone, however 9.7% of FXMC respondents indicated that they do not own or have access to one. Of patient respondents who own a smartphone, the majority have been using one for more than a year, as show in Table 7. Among patient respondents from SMHC, 70.8% have been using a smartphone for more than 5 years. Regarding frequency of Internet access, across all centers 31.6% of patients respondents use the Internet only on their smartphone, 57.8% use both a smartphone and computer to access the Internet. Among HKMC respondents, 12.5% indicate that they rarely use the Internet, and at FXMC 17.7% indicate that they never use the Internet.
Across all centers, patient familiarity with using mobile apps is high. While fewer than 1% of SMHC respondents indicated that they are not at all familiar or selected not applicable, 11.3% of HKMC and 19.4% of FXMC respondents selected not at all or not applicable. Familiarity was somewhat lower among patients over 40 years, with 58.4% indicating they are somewhat familiar with using mobile apps, while 77.5% of patients under 40 indicated they are very familiar. A majority of patients across all MHCs are familiar with WeChat, though there is some variation in age, with 81.9% of patients under 40 years indicating they are very familiar compared with 49.0% of those over 40. Among WeChat users, 84.1% of patients across all health centers use the app many times per day.
Patient use of the internet for health information and support
We asked patients to indicate the degree to which they use the Internet for health information and support, as described in Table 8:
As shown in Table 8, a majority of patients use the Internet to access general health information often (30.9%) or sometimes (47.8%). 4.6% of SMHC respondents, 11.4% of HKMC and 32.3% of FXMC patients indicate that they never use the Internet for health information. A majority of surveyed patients use the Internet for information specific to mental health, however among FXMC patients 30.0% state that they never use it, compared with 7.9% at SMHC and 14.8% at HKMC. Of the respondents who do use the Internet to search for mental health information, a variety of sources are accessed with little variation across mental health centers, as shown in Table 8.
In patient focus groups, participants described their use of the Internet for mental health information. A participant from an older focus group stated:
“When I was just diagnosed with depression… I did research about depression. I searched on Sohu.com , with information about the symptoms of depression, how bad it will be with no treatments, and why.” (HKMC Older)
A younger participant described the benefits they received from accessing online information:
When I first identified depression, I stayed into the patient group chat for quite a long time. Then I gradually followed some official accounts on Wechat. There were so many official accounts with inspiring articles which related to psychology. They benefit me very much, I got a lot of help from them. (SMHC Younger)
We also asked patients to indicate their level of perceived self-efficacy regarding the use of Internet resources for health decision-making and management. Regarding their confidence in using the Internet to find general and mental health related information a majority (55.5%) agreed though 34.2% were undecided, with results consistent across MHCs. In terms of their confidence in their ability to discern between high and low quality health information online, results were similar to the previous question. When asked about their confidence in using information found online to make health decisions, 43.5% agreed, 42.2% were undecided. There was more variation across levels of disagreement between MHC’s in this category, with 17.2% of SMHC patients disagreeing, while 4.5% from HKMC and 8.1% from FXMC disagreed. Finally, we asked patients to indicate whether they had previously used Internet sources to help manage their mental health conditions. 40.9% said yes, 40.9% said no, and 18.3% were not sure, with responses consistent across MHCs.
Patient acceptability of MBC and eMBC
Both surveyed patients and focus group participants were provided with brief vignettes describing the use of standard in-clinic MBC and eMBC and were asked to respond to questions related to acceptability of each approach. Survey results of patient acceptability of standard MBC are displayed in Table 9:
A majority of surveyed patients (65.1%) agree that they are willing to complete a questionnaire as described in the vignette. Some variations exist between health centers, with 15.9% of respondents from HKMC selecting somewhat disagree, compared with 3.3% from SMHC and 6.5% from FXMC. 15.2% of SMHC respondents strongly agree that they are willing, while 3.4% from HKMC and 4.8% from FXMC selected this response. Regarding the desire to play a more active role in making decisions about their treatment, agreement was strong across all MHCs, as shown in Table 9. When asked about the use of a questionnaire helping with depression treatment, again there was majority agreement across health centers. A majority of respondents across health centers also agreed that using a brief questionnaire could help them to discuss their depression with their clinician, though disagreement was somewhat higher at HKMC (Table 9). Finally, results related to the belief that using a brief questionnaire would help patients to understand their depression were consistent, with a majority agreeing with rates of disagreement again higher among HKMC respondents.
Results related to patient acceptability of eMBC based on a brief vignette are described in Table 10:
Regarding acceptability of eMBC among surveyed patients, a majority agree that they would be willing to use Internet-based resources to support managing their depression, willing to use an app to track their depression symptoms and in terms of their belief in their ability to use an app to respond to brief questionnaires regularly. Across all three categories, there is stronger agreement among SMHC respondents, while disagreement is higher among patients from HKMC and FXMC and higher disagreement among patients over 40 years (Table 10).
We provided focus group participants with the same vignette, eliciting responses related to perceived barriers and facilitators to using eMBC. A number of facilitators were identified. Broadly speaking, eMBC was seen as beneficial for both patients and clinicians:
“The patient can understand and record himself by using the app, and the clinician can better understand the changes of the patient’s emotion. I think this win-win situation is pretty good.” (SMHC FG1)
More specifically, the use of an app was seen as both economical in terms of saving time and money spent for in-person consultations, as described by a participant from SMHC:
Especially during initial assessment, let’s say the app is universal[ly] used in any clinics, then it doesn’t matter where the patient will have the initial assessment, since the initial assessment is just some form tests. Patients can save the consultation fee and the time. That is the truth, I think using the app does good to me. (SMHC FG1)
eMBC was also viewed as being more convenient:
“it’s very convenient, in terms of the time. For example, if you can do it on your mobile phone, then you probably can finish it on the public transit (bus, subway), or do it on their way (to the hospital). Without the app, you need to do it in the hospital.”. (FXMC Young)
Patients also acknowledged that eMBC might be more efficient for clinicians, helping to relieve some of the strain of a large number of clinical consultations each day. This was discussed by participants at SMHC:
“The app does not just present the result by adding scores, but let’s say, it can reduce the time that clinician has to inquire patients, and also can direct the patients to adjust themselves, then it is beneficial. I think this is what the app should be like.” (SMHC FG1)
And even have a positive impact on the reputation of the health center:
“I think that the Mental Health Center in Hongkou will soon be famous and customers will have a degree of adhesion, they will come by themselves and the center’s reputation will increase”. (HK young group)
Focus group participants also acknowledged that eMBC can help with understanding depression and self-management:
“With this app, for example, you can have an assessment and test for yourself, then you can have some prevention, that is, you can mediate yourself, or go to the hospital for medical treatment, let’s say, an early planning” (HKMC young group).
The collaborative nature of eMBC also appealed to patients:
“The patient can learn more about himself and these quantitative indicators can show him what is happening now, or what the whole course of the depression will be. If combined (with) the clinician’s expertise to develop a treatment plan, will increase the patient’s confidence. I feel that the patient can know himself better in this way, since people may get nervous when they don’t know what is happening”. (HKMC Young group)
Regarding whether they would adhere to eMBC instruction from their clinician, participant responses suggest that they value clinical advice:
“Absolutely. Whatever the doctor said, I will adhere to. Listening to the clinician is very important, whatever the clinician said is right”. (SMHC FG2)
Focus group participants also made suggestions about ways to improve the uptake and use of eMBC, including through promotion and awareness, as stated by a participants from FXMC: “maybe there should be some promotion” (FX Young)
“There are so many apps in the market, how can I assess if an app is good or not?” (HK Young group)
Regarding the need for training or education to support their use of eMBC, patient feedback was mixed:
One participant from SMHC stated that there is: “No need (for training). People can understand that by themselves”. (SMHC FG2).
While another stated: “I think there needed to be some guidance from a professional clinician. The patients then can know how to use and when to use, so that they can know how to get the best results”. (SMHC FG2).
Despite a number of facilitators identified by patients, not all focus group participant comments were positive about eMBC. Most prominently, participants voiced concerns about eMBC representing a replacement for in-person clinical contact, as illustrated by the following quotes from each MHC:
“...that the app can shorten the time of consultation, is actually also a shortcoming. Each patient with depression is very distressed. He is not understood at home nor in the society. Hey, I am seeing the clinician because I want to talk more with the clinician from whom I can get support and understanding. Why do I have to shorten the interview time? I think this is very difficult to understand…To my opinion, I am seeing the clinician to discuss with him my symptoms, I can do the measure later if I need to.” (SMHC 01)
“I think this should be discussed with the doctors. After all if you use the app and learn by yourself based on your medical conditions, it’s not professional. In addition, the medications usually have side effects, and if there are changes caused by the side effects, I feel it’s better to discuss with the doctors face to face”. (FXMC Young)
Consonant with some concerns voiced by clinicians, one patient from HKMC also spoke to concerns about eMBC eroding clinician expertise or authority:
“If the clinician relies solely on the result of the app then give the patient a corresponding diagnosis, everyone can be a clinician, right?...I am worried that the app will cause the deterioration of the clinician’s professional medical level… (and they risk becoming) over-reliant on the app”. (HK Young group)
Similarly, there is a perception that eMBC might lead to a loss of nuance in understanding or the human, interpretive element of a traditional clinical consultation. One SMHC participant said of using an app: “Then there is no need for Dr. [Name] showing up. A robot can do that too.”
“The subjective things cannot be quantified. Not every patient with depression has the same symptom nor will they have the same emotion feelings.” (SMHC 01)
Lack of conviction was also apparent in some focus group participants about clinical impact or accuracy of eMBC:
(Interviewer: Do you think using an app like this will improve your treatment and your mood?) “I don’t think so. I think it’s just for reference”. (FX Young group)
Another participant in the same focus group claimed: “it’s better to communicate with the doctors in person, face to face”. (FX Young group).
In a focus group among older adults at HKMC, participants also indicated their reluctance to use it, stating: “I will not use it,” “I would still rather focus on my Buddhism”, and “I feel that it might not be that accurate.” (HKMC Senior group).
Similarly to clinicians, some participants also questioned the ability of patients to accurately self-report symptoms, due to lack of insight or self-awareness, or even due a desire to see an improvement in scores:
“I may not be able to fully express the changes I had in the past period. Because the feeling of depression is comparatively subtle, it is not easy to describe”. (SMHC FG2)
“...since the questions in the measure are fixed, patient might change his answer next time just because he wants to have a better score instead of indicating his real feelings.” (SMHC 01)
From a more technical standpoint, concerns were also voiced about potential lack of long-term engagement with eMBC and about having to use or download a specific app:
“I guess when the app comes out, at the beginning people would be like, I’ll download it to measure my moods, but you need to consider the follow-ups. Some people may just download it, use it for measurement, and then they’d be like oh there’s nothing wrong, so they may uninstall. This could happen” (FX Young group)
This mixed methods situational analysis has identified several potential barriers and facilitators that will be essential for planning the implementation of MBC and eMBC at Shanghai mental health centers. These findings also make a substantial contribution to the literature on MBC implementation, which is growing in settings such as the United States [5, 7] and the United Kingdom  but remains limited in other contexts. Though the efficacy of standard MBC has been studied in China , factors influencing its implementation and that of eMBC have yet to be explored. The results of this situational analysis will directly inform the development of an eMBC implementation strategy to be tested via an RCT in Shanghai. The results also provide a broader contribution to the field of MBC implementation globally. Barriers and facilitators to MBC implementation exist at multiple levels and are heavily influenced by contextual factors. Understanding these factors can help to tailor multi-component implementation strategies to help promote successful implementation of MBC . A number of barriers and facilitators of relevance to MBC and eMBC implementation at the system level and from the perspectives of clinicians and patients were identified in this analysis and are discussed below.
Organization and system level
Understanding organizational and system-level factors is essential for developing strategies to promote successful and lasting implementation . We identified several potential barriers to MBC and eMBC implementation at the system level. Cost is a potential barrier that might affect the equitable delivery of MBC in Shanghai and, should MBC be scaled up, throughout China. The cost of medications varies greatly, and though many patients are insured and have access to subsidies when needed, the cost of some antidepressant medications may be prohibitive. This may in turn affect the full capacity of clinicians to adjust antidepressant medications based on MBC. Providers also cautioned that administration of outcome measures for standard MBC may involve an additional cost to patients. The cost of mental health treatment for patients in China can be substantial. A 2016 study  found that annual mental health costs more than tripled between 2005 and 2013, with direct out-of-pocket expenses for patients constituting approximately 40% of the total cost. The financial burden was higher among rural residents, with out-of-pocket mental healthcare expenditures accounting for approximately 50% of per capita disposable income. Costs associated with treating affective disorders were highest due to their elevated prevalence compared with other mental illnesses. The financial implications for patients will have to be considered when developing and adjusting treatment plans for patients based on MBC results in order to ensure equitable access to the highest quality evidence-based care.
Another potential barrier identified at the system level is the variation across centers in the likelihood of patients seeing the same clinician consistently. Lack of continuity of care may mean there is limited therapeutic alliance and impede consistent implementation of MBC. Continuity of care has been shown to have many health benefits  and may have an impact on implementation and outcomes related to MBC. This suggests that efforts should be made to ensure that patients are able to see the same clinician if they wish. In circumstances where this is unfeasible there is a need for systems that enable sharing of MBC and eMBC outcomes and treatment decisions among different clinicians.
There is also variation in EMR and Internet availability between centers. FXMC, the suburban center, uses paper records for outpatients and has less reliable Internet connection. The ability to integrate ‘measurement feedback systems’ such as those used in eMBC into existing EMR systems has been associated with improved use of MBC by clinicians in other contexts [5, 27]. The availability of EMR both within and across MHCs could therefore influence the implementation of MBC.
A final potential barrier at the system level is that currently outcome measures are only administered by psychometricians, meaning that clinicians may not be familiar with administering them and may not consider their administration to be within their purview. Being unfamiliar with both administering and interpreting outcome measures could represent a barrier to implementing MBC [24, 28], suggesting the need for enhanced training on the use of outcome measures for psychiatrists and other clinicians, in addition to awareness-raising about the availability and utility of these measures.
While surveys showed a high level of endorsement for the value of using MBC, surveys and interviews showed that in current practice for both initial and follow-up assessment, clinicians primarily make diagnoses and treatment decisions based on patient or family report of symptoms and functional impairment and observation. Clinicians reported minimal existing use of standardized outcome measures. This is consistent with findings of previous studies from the United States , where most clinicians only used measures regularly if mandated by workplace policies.
Reports of being trained in MBC also varied considerably. Clinician report of low levels of training in MBC was identified as a barrier to application in the United Kingdom  and in the United States , underscoring the need for enhanced training and education about the use of measures.
Regarding clinician knowledge and beliefs about MBC, despite positive attitudes towards MBC by surveyed clinicians, in interviews a number of potential barriers were identified. Time, including a considerable number of hours per day spent in patient care and the perception that explaining and administering MBC will take time out of already busy schedules, emerged as a consistent concern. Specific to eMBC clinicians voiced concerns that using digital technologies such as apps might impinge on their personal time and raise patient expectations for them to be available outside of regular hours. Time and workload, unsurprisingly, have been identified as potential barriers to MBC implementation in other contexts [3, 5, 24, 28]. Strategies to mitigate this barrier include choosing measures that require a minimal burden for both patients and providers and selection of brief measures . Using electronic technologies such as those employed in eMBC can also help to overcome time-related barriers .
A number of strategies are identified in the literature that might help to overcome some of these barriers related to negative attitudes or perceptions. Identification and involvement of local champions and opinion leaders, for example, is one approach to improve clinician attitudes towards MBC . The involvement of senior clinicians at SMHCs, including via involvement in training sessions, may represent an important strategy for overcoming some negative attitudes towards MBC. Involvement of clinicians in developing MBC protocols was also identified as a strategy to overcome clinician reluctance to implement it .
Training followed by organizational support and supervision is also essential for improving clinician attitudes towards and use of MBC [3,4,5]. Policy recommendations on the implementation of MBC in the United States suggest that the inclusion of MBC in continuing medical education (CME) training would increase widespread adoption. This approach could also be taken in Shanghai and in China more broadly. As few training programs have been established and disseminated for MBC in mental health settings , there is an opportunity to develop and implement a training program that can be used widely among Chinese clinicians and adapted for delivery in other contexts. The APEC Digital Hub for Mental Health (mentalhealth.apec.org), which is led by several study investigators (RL, JM, EM, CN, AG), can serve as a platform for delivery and sharing of training programs for MBC that can be adapted and disseminated across the Asia Pacific region.
A potential barrier regarding the feasibility of MBC was the perception among clinicians that patients might have low capacity or efficacy to respond to measures. Clinicians suggested that patients might face time limitations or be reluctant to engage in MBC. Some also suggested that patients might not be able to accurately complete measures because they lack sufficient insight into their depression. Clinicians also noted that literacy challenges and the cognitive effects of severe depression might impede patient ability to complete measures. Concerns by clinicians that patients will have trouble understanding measures or will find them difficult or stressful have been identified as barriers elsewhere .
Though clinicians in this study found MBC to be generally acceptable, they were also wary that using MBC/eMBC would replace more traditional clinical judgement and practices, which they consider fundamental to psychiatric practice. Many suggested that MBC and eMBC could be used in a complementary way but should not replace standard clinical practice and decision making. Concerns about loss of clinical “formality” and the belief that MBC is inferior to more traditional clinical assessment has previously been identified as a barrier to MBC use by clinicians [5, 24]. In a study on clinician attitudes towards using standardized outcomes measures for child mental health, Garland et al.  found that about half of clinicians questioned the concept of objectively assessing change in treatment outcomes, arguing that it is reductive to try to interpret a range of human behaviour and experience using what they perceived as one paradigm.
Some Shanghai clinicians saw increased patient involvement in treatment planning and tracking depression outcomes as a threat to the status quo, which they worried might lead to patients questioning clinician expertise, disagreements about appropriate treatment decision-making, and reduction in trust in clinicians. Some also worried that patients “knowing too much”, for example about the potential side effects of medications, might make them less likely to adhere to recommended treatment.
The perspective of patients is also essential to identifying barriers and drivers to MBC and eMBC implementation. Despite this, existing research about patient perspectives in MBC implementation, particularly in the field of mental health, is limited . This situational analysis identifies several barriers and facilitators to MBC and eMBC implementation that are of relevance both in the Chinese context and more broadly.
Understanding patients’ current use of the Internet and smartphones can help to identify barriers related to patient uptake of eMBC. Overall a majority of patients reported high frequency of Internet use and Smartphone ownership. There is variation, however, between suburban and urban patients, with suburban patients reporting lower levels of use regardless of age. Patient reported familiarity with and use of apps generally and WeChat specifically varies between age categories, with 81.9% of patients under 40 years familiar with WeChat compared with 49% over 40 years. The large proportion of Internet users in China has led to an increasing interest in use of digital health technologies for depression care . Though a majority of patients have used Internet-based resources to access health and mental health information, lower use of the Internet for health information was reported by patients at the suburban center (FXMC). High levels of Internet, smartphone and app use are promising for eMBC implementation success. However, the variation in usage among patients in suburban areas should be considered in implementation planning and may suggest that, in terms of broader scale-up, Internet, smartphone and app usage might vary in rural areas of China and among patients of different age groups.
Though general acceptability of eMBC by patients was high, some were concerned that eMBC would replace in-person contact with clinicians, which was highly valued. The therapeutic alliance with their clinician and the opportunity to discuss their depression symptoms openly, which may not be possible in other aspects of their lives, was seen as important. Similar to concerns expressed by clinicians, some patients were also worried that eMBC might undermine or replace clinician expertise, believing that eMBC could work as a complementary approach but should not be used to replace formal clinical expertise or the individualized, personal side of human interaction. The perception of patients that eMBC might actually take away from the therapeutic alliance and patient-clinician interaction could be addressed by awareness-raising efforts to inform patients that MBC approaches are in fact effective for increasing shared decision making in depression care and enhancing communication between patients and providers [2, 3, 32].
Similarly to clinicians, some patients expressed concerns about the capacity of patients with depression to accurately respond to measures when symptoms might impact their cognition or insight. Patient symptoms, in addition to barriers created by lack of accessible delivery of outcome measures (e.g. for patients who are visually impaired) may act as barriers to equitable engagement of patients in MBC and eMBC . Accessibility considerations as well as options such as patient navigators or liaisons can help to minimize these challenges . Given the important role of patient family members in supporting patients during consultations, family members could be engaged to support patients to complete outcome measures when needed.
Finally, some patients also voiced skepticism about the potential for long-term engagement with eMBC. Sustained use of mental health apps, even with high volumes of downloads, has been identified as a challenge in the field of digital mental health [33, 34]. In the case of eMBC, the integration of the use of electronic outcome measures into regular appointments with clinicians might help patients to sustain their engagement over their treatment course. Further, the integration of eMBC with a supported self-management programs, as is planned in this study, might further help to sustain the engagement of patients in tracking their depression outcomes for the duration of the self-management intervention.
Organization and system level
A key facilitator for the implementation of eMBC in Shanghai mental health centers is that, despite potential challenges in centers such as FXMC, the use of EMR and availability of computers and Internet at MHCs is largely widespread. Though it is certainly possible to implement standard MBC using paper and pencil, it is preferable to integrate outcome measure results into EMR [2, 5]. This can also facilitate collaboration and continuity across clinicians when patients see multiple providers .
In a qualitative study about clinician attitudes towards MBC in the United States, attitudes related to the clinical utility of MBC were varied, with approximately half stating that they believed using MBC was best practice while others were opposed to its use . Clinicians in Shanghai seem similarly divided. Despite the barriers associated with knowledge and beliefs described above, surveyed providers showed positive attitudes regarding the validity, reliability and effectiveness of MBC. Many interviewed clinicians also displayed positive attitudes and beliefs about MBC, describing it as more standardized, comprehensive and systematic than standard care. These positive attitudes are promising for the uptake and adoption of MBC by Shanghai clinicians. Evidence also suggests that using MBC and reviewing aggregate MBC data over time can be used by individual clinicians for professional development [2, 3]. Therefore, use of MBC and first-hand experience of its clinical utility may help to further improve clinician attitudes at individual, organizational and systems levels.
Many clinicians also expressed the belief that the increased engagement of patients via MBC could empower patients, improve their awareness and insight into their depression and treatment trajectory, and ultimately improve treatment adherence and outcomes. Patient empowerment has been identified as a benefit of MBC . Again, there is some disparity among clinicians about their perception of patient empowerment as a benefit compared with concerns about the implications of increased patient awareness and autonomy. These discrepancies will have to be navigated in planning for MBC implementation and addressed via training and supervision.
Regarding the feasibility of MBC and eMBC implementation, clinicians identified several factors that they believe would help to facilitate the use of MBC in their own practice, including proper training and resources, a dedicated staff person responsible for facilitating MBC, taking a team-based approach, and the availability of private space to complete measures. These factors are identified as facilitators to MBC implementation in other contexts [5, 29].
Importantly, before being asked about eMBC specifically, clinicians identified automation or electronic delivery as facilitators to implementing MBC, helping to overcome perceived barriers of implementing standard MBC including time constraints. When specifically asked about eMBC they believed that it might have benefits including improved patient knowledge about depression, improved treatment adherence and reduction in self-stigma. This suggests that eMBC might be more acceptable and feasible for clinicians compared with standard MBC. Clinicians suggested that marketing or awareness-raising programs to support the introduction of eMBC combined with adequate training for both clinicians and patients would help to facilitate its uptake and implementation. Adequate training and supervision along with workplace policies are identified as facilitators of MBC implementation [4, 5].
Overall, patients participating in this study demonstrated strong overall willingness to use outcomes measures and believed that MBC can help them manage symptoms and help them become more active in their treatment. They perceived eMBC to be efficient and convenient with the potential to improve their understanding of depression and their self-management capacity. Patients also agreed with clinicians that marketing or promotion and awareness programs about eMBC should be implemented in order to facilitate patient awareness and uptake of MBC and eMBC. There is little existing literature about facilitating factors for patient uptake and engagement in MBC. This study will therefore help to strengthen the evidence-based on patient-level factors influencing MBC and eMBC implementation.
Through this situational analysis we sought to develop a comprehensive understanding of the context of implementation for MBC and eMBC for depression in Shanghai mental health centers. A potential limitation is that the current study does not extensively describe systemic factors that might influence long-term implementation and scale-up of MBC. Though a comprehensive evaluation of broad mental health system factors is outside the scope of the current study, we have collected data in this area that we intend to publish separately.
Another limitation is the low sample size for some patient focus groups, which resulted from challenges with recruitment at some health centers. Though we anticipated higher levels of participation in patient focus groups, the mixed methods nature of this study helps to ensure that patient perspectives are well-represented. The value of mixed methods research is to allow for data triangulation, and we feel that the survey results, in addition to the focus group data, adequately captures the patient perspective.
Finally, this situational analysis examines contextual factors across three mental health centers in a city with a population of over 24 million people and may therefore not be representative of the population of Shanghai. We have included diverse health centers- one large tertiary hospital, one urban health center and one suburban health center- to help to ensure that this analysis captures the broad context of mental health care delivery in Shanghai. Further research, however, may be needed to understand contextual factors influencing scale-up of MBC to regions outside of Shanghai.
This situational analysis provides a comprehensive understanding of the potential barriers and facilitators to MBC and eMBC implementation in mental health centers in Shanghai, China at the organization and system level and from the perspective of clinicians and patients. This study makes an important contribution to field of MBC and implementation of evidence-based practices for depression. Though research about implementing MBC is growing in contexts such as the United States and United Kingdom, to our knowledge this is the first study to assess MBC implementation factors in China or in Asia more broadly. This study also specifically addressed factors influencing the implementation of eMBC, which is under-explored. The findings of this analysis will be used to develop and test, via an RCT, an implementation strategy for eMBC in Shanghai mental health centers. The results will help to inform scale-up throughout China and may help to inform implementation of MBC and eMBC in other global settings. The training program for clinicians developed through this study can be adapted to other settings and will be disseminated to other Asia Pacific contexts via the APEC Digital Hub for Mental Health.
Essential to the successful implementation of eMBC is ensuring that patients have equitable access to the benefits of evidence-based care for depression. Several factors that might influence equity were identified in this study. The cost of antidepressant medications and of the administration of outcome measures may make MBC and related treatment recommendations inaccessible to some patients. The use of and access to digital technology that is key to eMBC implementation might be disparate across locations and age groups, meaning that patients in more rural areas or in older demographics might be excluded. Accessibility of eMBC might also act as a barrier to equitable access, with general and digital literacy and disabilities such as visual impairment acting as barriers. These factors, while not always easy to address via one intervention, should be considered when planning for MBC and eMBC implementation and is planning for scale-up beyond the Shanghai context.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Enhanced Measurement based care
Fengxian Mental Health Centre
Global mental health
Hongkou Mental Health Centre
Measurement based care
Major depressive disorder
Randomized controlled trial
Shanghai Mental Health Centre
Yeung AS, Jing Y, Brenneman SK, Chang TE, Baer L, Hebden T, et al. Clinical outcomes in measurement-based treatment (COMET): a trial of depression monitoring and feedback to primary care physicians. Depress Anxiety. 2012;29(10):865–73.
Fortney JC, Unutzer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–88.
Scott K, Lewis CC. Using measurement-based care to enhance any treatment. Cogn Behav Pract. 2015;22(1):49–59.
Harding KJ, Rush AJ, Arbuckle M, Trivedi MH, Pincus HA. Measurement-based care in psychiatric practice: a policy framework for implementation. J Clin Psychiatry. 2011;72(8):1136–43.
Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, et al. Implementing measurement-based Care in Behavioral Health: a review. JAMA Psychiatry. 2019;76(3):324–35.
Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update). Implement Sci. 2016;11(1):146.
Trivedi MH, Daly EJ. Measurement-based care for refractory depression: a clinical decision support model for clinical research and practice. Drug Alcohol Depend. 2007;88 Suppl 2(Suppl 2):S61–71.
Guo T, Xiang YT, Xiao L, Hu CQ, Chiu HF, Ungvari GS, et al. Measurement-based care versus standard Care for Major Depression: a randomized controlled trial with blind raters. Am J Psychiatry. 2015;172(10):1004–13.
World Health Organization. Mental Health in China 2017. Available from: https://www.who.int/china/health-topics/mental-health.
Hu TW, He Y, Zhang M, Chen N. Economic costs of depression in China. Soc Psychiatry Psychiatr Epidemiol. 2007;42(2):110–6. https://doi.org/10.1007/s00127-006-0151-2. Epub 2007 Jan 17. PMID: 17235441.
Liu J, Ma H, He YL, Xie B, Xu YF, Tang HY, et al. Mental health system in China: history, recent service reform and future challenges. World Psychiatry. 2011;10(3):210–6.
Xiong W. Translated and annotated version of the 2015-2020 National Mental Health Work Plan of the People's Republic of China (M. R. Phillips, Trans.). Shanghai Archives of Psychiatry. 2016;28(1):4–17.
Martin W, Pauly B, MacDonald M. Situational analysis for complex systems: methodological development in public Health Research. AIMS Publ Health. 2016;3(1):94–109.
Murphy J, Michalak EE, Colquhoun H, Woo C, Ng CH, Parikh SV, et al. Methodological approaches to situational analysis in global mental health: a scoping review. Glob Mental Health. 2019;6:e11.
Patel V, Prince M. Global mental health: a new global health field comes of age. JAMA: J Am Med Assoc. 2010;303(19):1976–7.
Rasanathan K, Diaz T. Research on health equity in the SDG era: the urgent need for greater focus on implementation. Int J Equity Health. 2016;15:202.
Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncol Nurs Forum. 2014;41(5):545–7.
Richie JS. L qualitative data analysis for applied policy research. In: Huberman A, Miles MB, editors. The qualitative Researcher's companion. Thousand Oaks: SAGE; 2002.
QSR International Pty Ltd. NVivo qualitative data analysis Software. Version 11 ed. 2017.
Zung WWK. Zung self-rating depression scale and depression status inventory. In: Sartorius N, Ban TA, editors. Assessment of depression. Berlin, Heidelberg: Springer Berlin Heidelberg; 1986. p. 221–31.
Derogatis LR, Unger R. Symptom Checklist-90-revised. In: The Corsini Encyclopedia of Psychology; 2010. p. 1–2.
Hathaway SR, McKinley JC. Minnesota multiphasic personality inventory; manual, revised. San Antonio: Psychological Corporation; 1951. p. 31.
Rohan KJ, Rough JN, Evans M, Ho S-Y, Meyerhoff J, Roberts LM, et al. A protocol for the Hamilton rating scale for depression: item scoring rules, rater training, and outcome accuracy with data on its application in a clinical trial. J Affect Disord. 2016;200:111–8.
Zimmerman M, McGlinchey JB. Why don't psychiatrists use scales to measure outcome when treating depressed patients? J Clin Psychiatry. 2008;69(12):1916–9.
Xu J, Wang J, Wimo A, Qiu C. The economic burden of mental disorders in China, 2005-2013: implications for health policy. BMC Psychiatry. 2016;16:137.
Pereira Gray DJ, Sidaway-Lee K, White E, Thorne A, Evans PH. Continuity of care with doctors—a matter of life and death? A systematic review of continuity of care and mortality. BMJ Open. 2018;8(6):e021161.
Steinfeld B, Franklin A, Mercer B, Fraynt R, Simon G. Progress monitoring in an integrated health care system: tracking behavioral health vital signs. Adm Policy Ment Health Ment Health Serv Res. 2016;43(3):369–78.
Garland AF, Kruse M, Aarons GA. Clinicians and outcome measurement: What's the use? J Behavior Health Serv Res. 2003;30(4):393–405.
Hatfield DR, Ogles BM. Why some clinicians use outcome measures and others do not. Admin Pol Ment Health. 2007;34(3):283–91.
Goldstein LA, Connolly Gibbons MB, Thompson SM, Scott K, Heintz L, Green P, et al. Outcome assessment via handheld computer in community mental health: consumer satisfaction and reliability. J Behav Health Serv Res. 2011;38(3):414–23.
Wang Z, Niu Z, Yang L, Cui L. Internet-based Management for Depressive Disorder. In: Fang Y, editor. Depressive disorders: mechanisms, measurement and management. Singapore: Online: Springer; 2019. p. 267–76.
Hallgren KA, Bauer AM, Atkins DC. Digital technology and clinical decision making in depression treatment: current findings and future opportunities. Depress Anxiety. 2017;34(6):494–501.
Baumel A, Muench F, Edan S, Kane JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res. 2019;21(9):e14567.
Torous J, Jän Myrick K, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health. 2020;7(3):e18848.
We wish to acknowledge the study participants and thank them for sharing their experience with us.
Funding for this study is jointly provided by the Canadian Institutes of Health Research and the National Natural Science Foundation of China, under the Global Alliance for Chronic Disease’s mental health research funding stream. The funding agencies played no role in study design, data collection and analysis or writing the manuscript.
Ethics approval and consent to participate
Ethical approval for this study was obtained from the University of British Columbia’s Office of Research Ethics (Approval number: H18–00533) and the Shanghai Mental Health Center’s Institutional Review Board (Approval number: 2018–64). All study participants provided informed consent to participate. Survey participants were required to provide informed consent prior to accessing the survey via an online consent form. Interview and focus group participants provided written informed consent prior to commencing interviews. All participants were over the age of 18 years. This study was carried out in accordance with Canada’s Tri Council Policy Statement on Ethical Conduct for Research Involving Humans and the Declaration of Helsinki.
Consent for publication
JKM, JL, HC, HB, XY, TY, XW, YF, YH, ZW, YX, PZ, YS, JH, LH, LY, XL, TL, YF, and JC have no competing interests. EEM has received support for patient education activities from Otsuka.
RWL has received honoraria for ad hoc speaking or advising/consulting, or received research funds, from: Allergan, Asia-Pacific Economic Cooperation, BC Leading Edge Foundation, Canadian Institutes of Health Research, Canadian Network for Mood and Anxiety Treatments, Canadian Psychiatric Association, Hansoh, Healthy Minds Canada, Janssen, Lundbeck, Lundbeck Institute, Michael Smith Foundation for Health Research, MITACS, Myriad Neuroscience, Ontario Brain Institute, Otsuka, Pfizer, St. Jude Medical, University Health Network Foundation, and VGH-UBCH Foundation.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Murphy, J.K., Michalak, E.E., Liu, J. et al. Barriers and facilitators to implementing measurement-based care for depression in Shanghai, China: a situational analysis. BMC Psychiatry 21, 430 (2021). https://doi.org/10.1186/s12888-021-03442-5
- Measurement-based care
- Digital health
- Global mental health
- Situational analysis