- Research article
- Open Access
Acceptability of a digital return-to-work intervention for common mental disorders: a qualitative study on service user perspectives
BMC Psychiatry volume 21, Article number: 384 (2021)
There is an evident discrepancy between need and provision of evidence-based return-to-work (RTW) interventions in existing mental health services. Online dissemination of evidence-based interventions is presumed to reduce this gap. However, there is almost no knowledge available on perceived acceptability of digital RTW interventions among service users, which are factors that might influence the development and implementation of future interventions. The aim of this study was to develop knowledge of service user acceptability of mWorks, a proposed digital RTW solution.
Participants (n = 18) with experience of common mental disorder and sick leave were recruited with a purposive snowball sampling method. Semi-structured interviews (n = 12) and one focus group interview (n = 6) were conducted. A deductive thematic analysis was performed according to the Theoretical Framework of Acceptability.
Digital RTW interventions were perceived as acceptable and aligned with participant value. Participants expressed positive attitudes toward having access to support, regardless of time and place. A certain ambiguity between a decline in social interactions and opportunities to RTW in a safe space was reported. Participants were confident in their ability to use digital RTW solutions, but reported the need to reduce stressful elements of using smartphones. Overly demanding digital solutions, i.e. ones requiring high cognitive effort, were described as burdensome.
For digital RTW solutions to be acceptable, they need to complement traditional services by providing accessible and person-centred support throughout the RTW process. They should be designed to reduce the need for cognitive effort. Future research should explore how to balance user autonomy with other support components in digital interventions.
Common mental disorders (CMD) such as depression and anxiety are increasing globally and constitute one of the most common causes of reduced health . These illnesses are associated with substantial personal burdens, i.e. negative impact on well-being, lessened financial security, and risk of social isolation. In addition, mental illness contributes to a substantial societal cost in terms of sick leave, health care, and lost productivity estimated to cost €600 billion annually in Europe alone . Many individuals with CMD are on long-term sick leave . The societal cost of sick leave due to CMD is double that of individuals with physical conditions .
Few effective return-to-work (RTW) interventions exist for the target group of individuals with CMD . Traditionally, RTW support is fragmented and follows a step-by-step approach, a medical model in which single interventions in health services, e.g. medication and cognitive behavioural therapy, constitute the first steps and there is little connection to other RTW welfare services or the workplace [5,6,7,8,9]. The Swedish welfare system is highly sectored and the responsibility and commitments of a service user’s RTW process are scattered among Health Services, the Social Insurance Agency (SIA), the Public Employment Service (PES), and Social Services [7, 10]. Service and knowledge gaps create barriers to RTW and prolong periods of sick leave [6, 11,12,13]. In response to a dearth of effective RTW interventions, evidence-based supported employment (SE) for persons with severe mental disorders (SMD)  has been adapted with cognitive behavioural therapy (CBT) strategies to better fit the support needs of persons with CMD. This kind of intervention where SE and CBT strategies are integrated has been shown to be more effective than traditional services on RTW among persons with CMD in one Norwegian and one Swedish pragmatic, parallel randomized controlled trials [15,16,17]. However, recent implementation research highlights the discrepancy between the need and access to effective interventions . This dilemma is largely caused by two conflicting RTW paradigms, one that fosters a person-centred, strength-based, and recovery-oriented SE approach, and one that holds traditional standards and focuses on diagnosis, functional disability, and activity limitations [7, 17, 18]. In addition, staff and employers engaged in the traditional approach have shown to have low mental health literacy, adding to the knowledge and service gap [13, 19, 20]. Digital solutions have sparked a new hope of making RTW interventions accessible to a broad audience . Our aim was to develop a digital RTW intervention that covered the features of adapted SE intervention that include CBT strategies [15, 22]. Online delivery through smartphones may improve access to RTW interventions and play a role in reducing the service and knowledge gap.
As a precondition to evaluate effectiveness of interventions, the Medical Research Council has provided guidance on the need to test and refine such interventions to assure they are acceptable . Acceptability is a multi-factored construct that reflects the extent to which people perceive an intervention to be appropriate, i.e., anticipated or experiential cognitive and emotional responses to an intervention. Assessment of acceptability can take place before, during or after the intervention experience . However, there is an absence of a clear and shared framework of acceptability, which has led to an insufficiently robust research corpus. To remedy this, Sekhon and colleagues  provided the Theoretical Framework of Acceptability (TFA), the first systematic approach to developing a common understanding of acceptability. Researchers have recently begun to apply the TFA to evaluate acceptability in different stages of complex interventions, including development, evaluation, and implementation. For example, the TFA was applied in evaluation of the experiences of community pharmacists working in a men’s mental health program that helped to identify acceptability issues and inform changes in program design .
Previous research on acceptability in relation to CBT delivery formats shows a conflicting picture of whether face-to-face or digital interventions, with or without human support, are preferable. These inconsistent research results are likely due to comparisons of different formats [26, 27]. Two meta-analysis and a review showed that digital interventions with human support yield better outcomes than interventions without human support [26, 28, 29]. Lower acceptability would therefore be expected for digital interventions in unguided internet CBT (iCBT). However, this was surprisingly not found in a meta-analysis of delivery formats. One explanation may be that acceptability was operationalised as study dropouts, and not as experiential responses to an intervention . Inconsistencies in the current research corpus suggest a need to investigate acceptable delivery formats according to a standardized framework and the role of professionals when determining whether a digital RTW intervention will be successful.
Poor engagement of service users in digital solutions in primary care contexts, as well as slow dissemination, suggest other acceptability barriers [30, 31]. Acceptability has been explored during transformation of evidence-based interventions (e.g., CBT) to digital solutions (e.g., iCBT). A qualitative meta-synthesis concluded that acceptability relies on the sensitivity of the digital intervention to individual needs and preferences . In a feasibility study, evaluating the acceptability of a digital solution that aimed to decrease depressive symptoms and increase well-being at the workplace, it was reported that engagement issues constituted an acceptability barrier. This was attributed to the fluctuation of service users’ mental health, and that they did not have enough time for app usage which resulted in disengagement . However, little is known about the acceptability of digital RTW interventions from the perspectives of service users. Thus, there was a need to understand prospective acceptability, i.e., anticipated acceptability of mWorks, a proposed digital RTW intervention to be delivered by RTW professionals and used by persons on sick leave due to CMD throughout the RTW process. This understanding will serve to modify aspects prior to implementation, and thus inform the content of the proposed intervention.
While some research lessen the importance of digital intervention characteristics, other highlights the need to address these characteristics for service user acceptability. The latter are associated with emotional state, attitude, and the severity of depression, each of which affects service user acceptability of an intervention [24, 34]. Insights from a previous acceptability study on digital positive psychology intervention for persons with CMD add that factor such as a persuasive design, easy accessibility, a credible reputation, and not requiring too much effort for interaction, personality and symptom severity were important to consider when creating an acceptable digital solution . Symptom severity is associated with low levels of engagement, mediated by decreased levels of motivation and interest in previously enjoyable tasks . Therefore, it is vital to establish how digital interventions such as mWorks can be designed to meet potentially decreased engagement levels of service users with CMD.
A lack of conclusive knowledge hampers the ability to design acceptable digital interventions for this target group. Qualitative methods are well suited to investigate anticipated acceptability of the intended audience [24, 34, 36]. No research has previously examined perceived acceptability of a digital RTW intervention with a standardized framework of acceptability. Thus, by conducting a qualitative thematic analysis we aimed to decrease the knowledge gap and increase the understanding of service user acceptability of mWorks, a proposed digital return-to-work solution for persons with experience of CMD and sick leave using the TFA.
A qualitative research design with a deductive thematic approach  was used in order to analyse participant perceptions of acceptability of mWorks. A top-down thematic analysis method was chosen because it tends to generate detailed information about specific aspects of the data, in this instance, information related to the seven acceptability attributes of the TFA . This is in contrast to a bottom-up thematic analysis which tends to yield richer descriptions from the entire data corpus .
This study is part of a larger project in the southern region of Sweden with the aim or developing and evaluating a digital RTW intervention, mWorks, for persons with CMD . It is in accordance with the 2008 revision of the Helsinki Declaration has been approved by the Ethical Review Board in Lund, Reg. No 2017/324. This study was guided by consolidated criteria for reporting qualitative research, COREQ .
Recruitment and participants
Inclusion criteria included being of working age, 18–65 years, having current or lived experience of sick leave and the RTW process, self-reported diagnosis of a CMD, (i.e., depression, including depressive episodes inherent in bipolar disorder and/or anxiety disorder) and able to communicate in Swedish.
A purposeful snowball sampling method was utilized where initial participants nominate other potential participants using their network . This recruitment method enabled us to find information-rich participants that otherwise are difficult for researchers to access, who belong to a vulnerable group in various care or RTW support programs for persons with CMD . Initially, the first author (PE) contacted four previously known mental health and RTW professionals who had regular contact with potential participants during the course of their daily work at social services, Fountain House clubhouses (non-profit mental health service where members are provided with opportunities for RTW support), primary care, and mental health services. The professionals were asked to nominate individuals who met the inclusion criteria. The nominated individuals were contacted via email or face-to-face by the professionals and asked to participate. They received oral and written information about the study. To verify the inclusion criteria, nominated participants were asked by the first author (phone, email) if they recently had been sick-listed due to CMD (according to medical certificate for sick leave), if they currently were involved in a RTW process, or had prior experience of being on sick-leave due to CMD and involved in a RTW process. The initial two individuals agreed to participate. These two participants then nominated additional individuals, and asked if they wanted to participate. If the additional individuals were interested in participating, they were contacted by the first author (PE) and further informed about the study. All participants gave written informed consent prior to the interview.
Individual (n = 12) and focus-group (n = 6) interviews were conducted between April 2017 and January 2018. The individual interviews were intended to generate a broad range of topics. The focus group interview aimed to reveal additional insights about more sensitive and personal viewpoints. These revelations are more frequently occurring in a focus group context where participants from a homogeneous group can explore their group identity, challenge aspects inherent to their subculture, and thereby exposing aspects that ordinarily are out of reach in an individual interview context . The interviews were semi-structured  and focused on generation of information about participant experiences, needs and preferences concerning the mWorks intervention. Prior to the interviews, participants had accessed verbal and written information about the purpose and design in connection to informed consent. In addition, brief and standardized verbal information about the project and proposed digital RTW solution was written at the top of the interview guide to be easily introduced. The interview guide was the same for both types of interviews and derived from a similar study that aimed to develop a digital service for childhood cancer survivors within a health service context . The interview guide was adjusted to fit the current target group by addition of probing questions regarding the RTW context. According to the preferences of the participants, interviews took place at participant homes or at the university research facilities (Lund University). The first author (PE) conducted most individual interviews, while the last author (UB) conducted the first individual interview and moderated the focus group interview with an assisting researcher who took field notes and posed probing questions when needed. Each interview was audio-recorded and supplemented with field notes to capture additional observations that added meaning and understanding to the interview. Individual interviews lasted approximately 30 to 45 min, and the focus group interview lasted about 60 min. To protect participant confidentiality, each transcript was stripped of identifiable details, assigned an anonymous code, and stored securely.
The recorded interview material was transcribed verbatim. The material was subjected to a “top-down” thematic analysis  and the themes were driven by a theoretical framework of acceptability (TFA) . The framework entails seven constructs (Fig. 1) and can be used to understand how people consider a healthcare intervention to be appropriate, based on expected or experienced cognitive and emotional responses to an intervention . This could be done before (prospective acceptability), whilst (concurrent acceptability) or after (retrospective acceptability) participating in an intervention. In our study we investigate prospective acceptability.
The analysis procedure initially involved reading through the field notes and transcripts. A software tool specifically developed to analyse qualitative data, Open-Code version 4.03, was used to organize and gain an overview of the data. Content from the transcripts was identified that corresponded with the acceptability attributes and initial coding into themes was performed by the first author (PE). The themes were then collapsed to smaller components to clarify distinctions in the material. Next, UB scrutinized the first author’s (PE) interpretation of the data, which was an iterative process, to ensure that the interpretations of the themes were credible. Subsequently, all three authors worked together iteratively to ensure that the narrative represented the data, which helped to form consensus. For example, one participant explained how digital solutions may provide a sense of security and safety since mWorks makes the RTW support accessible. This was assigned the acceptability construct of affective attitude and assigned to the theme creates a sense of safety.
In total, eighteen individuals agreed to participate. There were twelve individual interviews and one focus-group interview with six participants. In this sample, the distribution between the genders were favourable towards men (n = 11) in comparison to women (n = 7), with a mean age of 41 years (range 25–74). Participants reported having a mean experience of CMD 5 years (range 1–40). Depression (75%) was the most frequently reported diagnosis, followed by bipolar disorder (17%) and general anxiety disorders (8%). 22% of the participants were currently on sick-leave due to CMD (n = 4), 22% were currently involved in a RTW process (n = 4), and 56% had prior experience of being on sick-leave due to CMD and RTW (n = 10). With regards to educational level, 58% reported having completed a University degree, 33% Upper secondary school, or 8% reported of nine-year compulsory school, or lower. All participants were of ethnic origin in Sweden and spoke Swedish.
The findings presented below are based on the seven constructs of the TFA. The most commonly raised construct in our analysis was burden, followed by affective attitude, ethicality, perceived effectiveness, opportunity costs, self-efficacy, and last intervention coherence (Table 1).
Participants stated that mWorks needed to avoid feelings of being judged. They expressed difficulty in facing family and professionals due to being negatively judged in the context of their shortcomings and not following through on their responsibilities. This was explained as producing feelings of guilt. In order for mWorks to be acceptable, a judgmental tone needed to be avoided.
“It should not be interpreted as judgmental if you miss certain meetings and such. Well, you can get a reminder that now you have missed this and that many, but not like a red flashing app.” [Individual interview 3]
Participants felt that mWorks should not make service users feel any different from others, regardless of their mental health problem. Otherwise, such an application would be perceived as offensive and judgmental. Furthermore, participants cautioned against designing mWorks as too childish because this would come across as stigmatizing.
mWorks needed to create a sense of safety. Digital solutions were thought to need to be capable of delivering support regardless of time, pace and place. Knowing that they had access to support available through their mobile device provided participants with a sense of security. In contrast frustrations about the inadequacy of traditional vocational rehabilitation services in terms of continuity and long-term sustainability were described. Not knowing if support would be available when it was most needed produced a sense of insecurity. One service user expressed frustration at being abandoned without adequate RTW support during relapse.
“But three weeks later, you are back at square one anyway...they felt that you were done there, somehow.” [Individual interview 10]
Participants described the need to create a harmonious feeling when they signed in to mWorks for the first time. This was regarded as important to arrive in a space that were pleasant and free from annoyances. Likewise, a focus on positives instead of negatives would facilitate a harmonious atmosphere. In contrast, too many required actions, software bugs, and unresponsive tactile sensation (i.e. input delay when touching the mobile screen) could contribute to the elimination of a harmonious impression.
Participants explained the need for flexibility regarding feedback to reduce the perceived burden of using a digital platform. There were contradictory statements in relation to feedback, making it clear that feedback is a double-edged sword. The use of feedback was perceived as both a facilitator and a barrier for RTW. On the one hand, feedback was a powerful tool to increase motivation through rewarding the completion of tasks, showing user progress and return-to-work trajectory. On the other hand, feedback could be burdensome, since negative patterns would become apparent and could reinforce negative emotions, thoughts and behaviours. Participants recommended that feedback should not be mandatory and should be used with caution. The suggestion was for mWorks to foster individualized options of how to use and approach feedback functions.
Motivational difficulties were described as an engagement barrier for mWorks. According to the participants, this was predominantly a product of depressive symptoms that may make it burdensome to engage with a proposed digital intervention. Participants anticipated that engagement with mWorks would be difficult during more severe periods of depression or anxiety. They all shared experiences of having problems with getting out of bed and wondered how they would have the energy and mental fortitude to participate in the intervention.
“It is hard enough to do things at all, because you are so terribly exhausted or depressed. So why does it make sense to do it? ... You do not see that much meaning in doing things. You do not think that it will help anyway.” [Individual interview 10]
One participant suggested the importance of providing the user with the why(s) for using mWorks, i.e., why this specific activity would be useful for the RTW process. Such understanding could provide smaller activities or subtasks with meaning.
“That there may be different colours for when it is about work, when it concerns the municipality, and when it is (health) care. Then you get a brief overview... Okay, now I have some municipal meetings there, some care meetings there, and some meetings at work there.” [Individual interview 1]
The participants valued increased service user control over the use and access to their own data and progress. They explained that no one but service users themselves should dictate how to use mWorks. Rather, autonomy regarding how much and what parts of mWorks to use was valued. Self-determined involvement was perceived to foster ownership of their RTW process. Although most participants valued the ability for service user control, one participant did not think user control was preferable. On the contrary, leaving the responsibility to the professionals was a relief. Furthermore, data generated by the service user must be secure, with access restricted to the user. Taking adequate safety measures were described as paramount in order to guarantee the safety of personal information.
“It should be very clear that it is you alone who governs this. That it is you who are the focus. It is you that this is about. So, if you don't want A, B, or C to get some information or know that you have missed these meetings ... they shouldn't be able to do that either. They shouldn't be able to go in the back way somehow. [That] you should feel safe.” [Individual interview 3]
Participants wanted to share their data with other RTW actors, under the condition that the service user had full authority to decide who would have access to their data.
A reduced clinical and deficit-oriented approach suited participant values. Having a clinical approach or focus was felt to place emphasis on negative aspects and problems.
“I think it shouldn’t be too clinical. It shouldn’t say ‘the County Council of Scania’ on it.” [Individual interview 7]
Participants wanted mWorks to promote positivity and focus on the recovery process and problem-solving. A clinical focus was felt to contribute to reinforcement of the individual’s self-stigma for being on sick-leave and having a mental illness.
Participant understanding of mWorks indicated that the intervention counteracts evasive behaviour. The use of calendars and notifications were explicitly mentioned as tools to mentally prepare for daily tasks and behaviours required to progress toward RTW. Mental preparation was described as counteracting evasive behaviour since the intervention strengthened the individual by planning and strategizing about future events, such as meetings with rehabilitation actors.
“If it turns out that in two hours I’ll have to go to this meeting and I wasn’t mentally prepared, then it might be that I don’t go at all.” [Individual interview 1]
Seeking family member approval in relation to the participants and their life situation was described as a constant challenge. mWorks was perceived to legitimize their actions towards RTW, concerning their family members, or other persons in their social network. They could be transparent about what they were working on, their progress, and what rehabilitation actors were involved in the process. Participants reported that displaying where they were in their RTW process to family members provided them with a feeling of accountability, and made them more likely to follow through on their commitments.
Participants cautioned about the potential danger of replacing human contact with a digital interaction. Therefore, in order to be acceptable, a digital intervention must be designed as a complement to traditional RTW support, not a substitute. Some participants valued the social interaction with rehabilitation actors. This benefit was thought less likely to occur if human interaction was replaced with digital contact. However, some individuals prefer to manage their contact with RTW actors through digital means, and it was highlighted that individual preferences should dictate the levels of human interaction. The cost of reducing human contact was compensated for by mWorks making it possible to have a safe digital space to progress. Participants valued a digital space where service users could process RTW related issues and progress towards RTW in a safe space, free from external stressors, in an environment of their choosing.
For participants to accept mWorks as an effective RTW intervention, it must involve the entire RTW process. The advantage of using mWorks was the ability to gather everything related to the RTW process in one place. mWorks needed to have a holistic view of the service user and not focus blindly on the RTW outcome alone. To focus on everyday needs such as food, medication, and general well-being was also important.
Participants had confidence that digital strategies could reduce stress and anxiety. For example, internet-delivered Cognitive Behaviour Therapy (iCBT) and other digital meditation practices were mentioned as effective treatments because users can access support regardless of place and time. Some scepticism arose regarding the mindfulness intervention practice because the general public is perceived to harbour negative preconceptions toward it.
“Because I believe many people think it's (mindfulness) hocus-pocus... But I think CBT works if used in combination with returning to work.” [Individual interview 10]
mWorks was thought to enable a proactive rehabilitation process, where service users could be intercepted before a relapse. mWorks facilitated preventive and early interventions. These attributes were explained as important advantages of digital solutions, and made participants consider mWorks as a potentially effective RTW solution.
Participants were confident in their ability to use digital platforms as a tool for RTW. They attributed their confidence to feeling comfortable with handling mobile devices in their everyday life. Participants explained that such social media is an integral part of smartphone usage. However, the use of additional applications such as mWorks on their smartphones could inhibit participant self-efficacy because the use of too many digital solutions can increase the stress level of an individual. They feared that their confidence in performing the required tasks in mWorks would be inhibited. They noted that smartphones were distracting because they are always prompting for attention. Participants explained the need to “take a break” from the phone. One participant explained:
“The mobile device has also become stressful, because as soon as I open it, there would be SMS and stuff … So, that is why I had to put it away for a while.” [Individual interview 7]
Another participant suggested that it was important to be able to turn of notifications or adjust notifications to the individual’s liking.
“Only the most essential should reach you. If Facebook and such things, notices should be on, … it can ruin a lot. You get distracted.” [Individual interview 3]
Participants perceived that the acceptability of digital solutions were especially dependent on age and earlier digital experiences. Older individuals were not believed to be as confident as the younger users, but could make up for it if they had prior experience of using digital tools on a more frequent basis.
The present study demonstrates that the expectations of mWorks as a digital RTW solutions are acceptable to service users with CMD. In essence, acceptability was present when mWorks focused on producing a positive affective attitude and fostering a stress and judgment free environment, where users can progress toward RTW to in a safe space. To increase perceived effectiveness, a digital solution needs to be designed to complement traditional RTW services and reflect an integrated and recovery-oriented approach. This contrasts to the stepwise, diagnosis and deficit-oriented approach that was deemed problematic. Attending to the perceived burden of usage is critical since this is related to motivational difficulties and cognitive strain among persons with CMD. Simultaneous user autonomy on approach and use of mWorks is necessary to avoid increased stress levels that risk reducing self-efficacy, and thus negatively impacting engagement levels.
Although there is ambiguity about the importance of human support for acceptance of digital solutions [26, 27], our findings indicate that the service user needs to be given the opportunity to direct the level of human interaction. Service users value the potential to complement traditional RTW services with access to fast and reliable human support, as well as the opportunity to progress towards RTW in a safe space with minimal amount of human interaction. That service users deem ordinary contact with RTW actors as too stressful has been observed elsewhere , and it is therefore crucial to consider the type, frequency, and duration of human support in order to optimize the delivery format . This is imperative because the removal of human support might jeopardize positive effects on outcomes and the greater retention noted in previous research [28, 45, 46]. A way forward may be to use AI-directed chatbots that can serve to mimic human support and increase engagement and attrition rates of digital solutions . In a recent trial it was concluded that these AI-directed conversational agents appear to be an engaging and effective way to deliver CBT for persons with CMD . If similar effects can be derived for digital RTW solutions remains a subject for future research prospect.
The importance for service users to experience hope, power, and meet professionals who apply a person-centred and holistic approach during the RTW process are demonstrated to be critical RTW factors for persons with CMD . Our findings suggest that mWorks must involve the entire RTW process to be perceived as effective. Service users described frustrations about traditional RTW services lack of sustainable support, and absence of a holistic approach throughout their RTW process. This fragmented process is hard to manage, and produces a sense of insecurity. Incorporation of important constituent elements in the RTW process through a digital solution can address this problem. One such element is inclusion of strategies to increase well-being and mental health, such as digital cognitive strategies, that has demonstrated to improve such outcomes [48, 49]. Another important element is the ability to plan and strategize RTW actions, as this is an important cornerstone in supported employment interventions [15, 16]. Thus, mWorks needs to incorporate a broad range of content in order to encompass the entire RTW process, when returning to and remaining at work, and be perceived as effective, and thereby acceptable.
mWorks was considered ethically acceptable if service users had the opportunity to control how to use and approach the digital solution. Research on developing digital solutions for health-related behavioural change indicates that offering too many choices or complete navigational control can be overwhelming and result in lower use. This points out the tension between supporting user autonomy and clear guidance on how to best engage with the intervention to change behaviours . The more choices and actions service users are exposed to, the more cognitive strain is increased, and this could negatively affect acceptability. Indeed, too much freedom of use can be perceived as burdensome and result in lower levels of engagement compared to exposure to a coherent presentation of essential intervention components [50, 51]. The need to find a balance between dichotomies such as clear guidance or complete freedom in use of digital interventions has been noted elsewhere. Research is vital during the development phase in order to establish what services users prefer to do on their own and when clear directives are needed [32, 36]. Further research should investigate which activities users prefer to do without those activities becoming burdensome, and how to provide a system that allows independence and control.
Research has shown that symptom severity in depression is associated with lower levels of engagement . This may constitute an acceptability barrier and impede engagement with mWorks if not addressed during development. Engagement barriers are one of the bigger barriers for implementation of digital innovations in European health care systems , since the average user spends 5 min or less on learning a digital solution . Consideration of factors that ameliorate user deficits in engagement is crucial and could improve retention during digital RTW solutions. Future research on adequate strategies to increase motivation and provide users with tasks they find feasible and meaningful is needed. Positive feedback should be considered during development, as it can be a powerful tool to enhance motivation but must fit the needs of service users. RTW professionals have an important role when delivering mWorks. They have the opportunity to discuss and tailor feedback according to service user needs and preferences, in a way that is not possible in a digital context . Similar to previous research , our findings further instantiate that service users’ fluctuation in symptom severity, and thus perceived burden, is a prominent acceptability barrier. This indicates that service users may be less likely to interact with cognitively demanding tools and that variability in symptoms needs to be accounted for in the development of digital solutions. Moreover, future research inquiries should investigate how digital solutions can account for this variability.
The theoretical framework for acceptability provided a useful model as the accompanying components analyse specific aspects of the data corpus that are associated with service user perceived acceptability of a digital RTW solution. An unclear understanding of acceptability in previous literature resulted in an inadequately robust research corpus, and that interventions often fail to be embedded in practice [20, 53]. This situation reduced transferability of research findings, which the TFA framework can help to remedy. Co-production has been stressed as a main important factor to understand, reach and engage users that are going to use the digital solution in practice [45, 54, 55]. Thus, investigating acceptability prior to participation of mWorks was essential to increase the understanding of how the digital solution could be aligned with the users’ perspectives of acceptability in order to be integrated into practice. However, some constructs were challenging to employ in this setting because the intervention was in a formative stage, and intervention components were not fully determined. For example, it was not clear how the construct intervention coherence could help anticipate acceptability. Consequently, explaining the overarching intervention components to participants was essential. The framework would benefit from added clarification and development on how to analyse anticipated acceptability when the intervention still is in a formative stage.
Qualitative methods do not provide generalizable evidence. Therefore, generalized claims should be made with caution and finding herein might not be generalized to other contexts. However, the use of TFA and COREQ has improved research description and quality. In that sense, transferability becomes possible for readers, who can make own inferences . Findings may further be interpreted as relevant to inform future development of the mWorks.
Although purposive snowball sampling was used since it yielded information-rich participants of a hard-to-find target group, the participants might not be representative of the entire group of persons with CMD and RTW experience. Although data saturation appeared to be met, with no additional insights arising in the final interview, it is possible that a wider range of participants (such as inclusion of younger people) would have provided additional aspects of acceptability. Future research should investigate needs and preferences of these subgroups to uncover all features of acceptability.
The authors have been or are currently involved in the development of mWorks and have preconceptions of what would be acceptable to the service users. This might have contributed to bias in the interpretation of the data. However, the analyses were conducted within a multidisciplinary research team with expertise in their respective research fields, including public health (PE), digital development and participatory research (PS), and research on SE and critical factors for RTW, and implementation (UB). This mixture of perspectives may have minimized personal biases and helped to ensure credibility of the findings. In addition, the deductive analysis according to the TFA model provided researchers with a common understanding of acceptability, which helps to mitigate biases, improves transferability, and thereby increases the trustworthiness of our study. Participants did not get the opportunity to member check our findings, which is a limitation of this study.
This study sheds much-needed light on the acceptability of mWorks, and will help to inform future development of digital RTW interventions that are engaging and appealing to service users with CMD who are on sick leave. To create a positive user experience was addressed as vital. This entailed providing a safe digital space and a stress and judgment-free environment where service users have an opportunity to progress toward RTW. Perceived effectiveness was linked to the ability of mWorks to complement traditional RTW services with access to the entire RTW process according to user needs and resources. Participants found this a desirable departure from a diagnosis and deficit-oriented approach. Reducing the cognitive burden was perceived as critical for acceptability. High cognitive burden can jeopardize service user self-efficacy and negatively impact engagement levels. Future research should more fully explore perceived burden in order to understand the balance between user autonomy and other support components in digital solutions.
Availability of data and materials
The interview guide is provided as Supplementary file 1. Original quotations from the data corpus are used to support the analysis procedure. A substantive, pseudo-anonymous collection of extracts from each participant interview is available from the corresponding author upon reasonable request.
Cognitive behavioural therapy
Common mental disorder
Internet cognitive behavioural therapy
Medical Research Council
Public Employment Service
Return to work
Social Insurance Agency
Severe mental disorders
Theoretical Framework of Acceptability
World Health Organization. Depression and other common mental disorders: global health estimates. Geneva: World Health Organization; 2017. p. 1–17. https://www.who.int/mental_health/management/depression/prevalence_global_health_estimates/en/
OECD/European Union. Health at a Glance: Europe 2018: State of Health in the EU Cycle. Brussels: OECD Publishing, Paris/European Union; 2018. https://doi.org/10.1787/health_glance_eur-2018-en.
Dewa CS, Loong D, Bonato S. Work outcomes of sickness absence related to mental disorders: a systematic literature review. BMJ Open. 2014;4(7):e005533. https://doi.org/10.1136/bmjopen-2014-005533.
Dewa CS, Chau N, Dermer S. Examining the comparative incidence and costs of physical and mental health-related disabilities in an employed population. J Occup Environ Med. 2010;52(7):758–62. https://doi.org/10.1097/JOM.0b013e3181e8cfb5.
Joyce S, Modini M, Christensen H, Mykletun A, Bryant R, Mitchell PB, et al. Workplace interventions for common mental disorders: a systematic meta-review. Psychol Med. 2016;46(4):683–97. https://doi.org/10.1017/S0033291715002408.
Johanson S, Bejerholm U. The role of empowerment and quality of life in depression severity among unemployed people with affective disorders receiving mental healthcare. Disabil Rehabil. 2017;39(18):1807–13. https://doi.org/10.1080/09638288.2016.1211758.
Bejerholm U, Larsson L, Hofgren C. Individual placement and support illustrated in the Swedish welfare system: a case study. J Vocation Rehabil. 2011;35(1):59–72. https://doi.org/10.3233/JVR-2011-0554.
Bonfils IS, Hansen H, Dalum HS, Eplov LF. Implementation of the individual placement and support approach – facilitators and barriers. Scand J Disabil Res. 2017;19(4):318–33.
Patrick W. Corrigan, Stanley G McCracken. Place first, then train: an alternative to the medical model of psychiatric rehabilitation. Soc Work. 2005;50(1):31–9.
Hasson H, Andersson M, Bejerholm U. Management: barriers in implementation of evidence-based practice: supported employment in Swedish context. J Health Organ Manag. 2011;25(3):332–45. https://doi.org/10.1108/14777261111143563.
OECD. Mental health and work: Sweden, Mental Health and Work. Paris: OECD Publishing; 2013. https://doi.org/10.1787/9789264188730-en.
Bejerholm U, Areberg C, Hofgren C, Sandlund M, Rinaldi M. Individual placement and support in Sweden—a randomized controlled trial. Nord J Psychiatry. 2015;69(1):57–66. https://doi.org/10.3109/08039488.2014.929739.
Lexén A, Emmelin M, Hansson L, Bejerholm U. Exploring the service and knowledge gap between rehabilitation professionals and employers in the return-to-work process of people with mental health problems in Sweden. Work. 2019;64(3):495–506. https://doi.org/10.3233/WOR-193011.
Modini M, Tan L, Brinchmann B, Wang M-J, Killackey E, Glozier N, et al. Supported employment for people with severe mental illness: systematic review and meta-analysis of the international evidence. Br J Psychiatry. 2016;209(1):14–22. https://doi.org/10.1192/bjp.bp.115.165092.
Bejerholm U, Larsson ME, Johanson S. Supported employment adapted for people with affective disorders—a randomized controlled trial. J Affect Disord. 2017;1(207):212–20.
Reme SE, Grasdal AL, Løvvik C, Lie SA, Øverland S. Work-focused cognitive–behavioural therapy and individual job support to increase work participation in common mental disorders: a randomised controlled multicentre trial. Occupational and environmental medicine. Occup Environ Med. 2015;72(10):745–52. https://doi.org/10.1136/oemed-2014-102700.
Porter S, Lexén A, Johanson S, Bejerholm U. Critical factors for the return-to-work process among people with affective disorders: voices from two vocational approaches. Work. 2018;60(2):221–34. https://doi.org/10.3233/WOR-182737.
Johanson S, Markström U, Larsson ME, Bejerholm U. Implementation of a novel return-to-work approach for persons with affective disorders in a traditional vocational rehabilitation context: a case study. Int J Ment Heal Syst. 2020;14(1):22. https://doi.org/10.1186/s13033-020-00355-w.
Porter S, Lexén A, Bejerholm U. Mental health literacy among vocational rehabilitation professionals and their perception of employers in the return-to-work process. Vocation Rehabil J. 2019;50(2):157–69. https://doi.org/10.3233/JVR-180997.
Porter S, Lexén A, Bejerholm U. Employers’ beliefs, knowledge and strategies used in providing support to employees with mental health problems. J Vocation Rehabil. 2019;51(3):325–37. https://doi.org/10.3233/JVR-191049.
Lord SE, McGurk SR, Nicholson J, et al. The potential of technology for enhancing individual placement and support supported employment. Psychiatr Rehabil J. 2014;37(2):99–106. https://doi.org/10.1037/prj0000070.
Bejerholm U, Sundquist J, Lars H, Gerdtham U, Stjernswärd S, Petersson G, Svedberg P. Work support in your pocket: Development and evaluation of mWorks, a digital mental health intervention to support RTW, participation and empowerment for persons with mental health problems. 2017. https://portal.research.lu.se/portal/en/projects/work-support-in-your-pocket-development-and-evaluation-of-mworks-a-digital-mental-health-intervention-for-returntowork-participation-and-empowerment-among-persons-with-mental-health-problems(4ff0939e-10e9-49b2-9d0c-63d4bdc7cfcc).html.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88. https://doi.org/10.1186/s12913-017-2031-8.
Murphy AL, Gardner DM. Pharmacists’ acceptability of a men's mental health promotion program using the theoretical framework of acceptability. AIMS Public Health. 2019;6(2):195–208. https://doi.org/10.3934/publichealth.2019.2.195.
Cuijpers P, Noma H, Karyotaki E, Cipriani A, Furukawa TA. Effectiveness and acceptability of cognitive behavior therapy delivery formats in adults with depression: a network meta-analysis. JAMA Psychiatry. 2019;76(7):700–7. https://doi.org/10.1001/jamapsychiatry.2019.0268.
Apolinário-Hagen J, Kemper J, Stürmer C. Public acceptability of e-mental health treatment services for psychological problems: a scoping review. JMIR Mental Health. 2017;4(2):e10. https://doi.org/10.2196/mental.6186.
Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42. https://doi.org/10.1016/j.cpr.2012.02.004.
Stefanopoulou E, Lewis D, Taylor M, Broscombe J, Ahmad J, Larkin J. Are digitally delivered psychological interventions for depression the way forward?. A review. Psychiatric Q. 2018;89(4):779–94. https://doi.org/10.1007/s11126-018-9576-5.
Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health-attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. 2014;14(1):109. https://doi.org/10.1186/1471-244X-14-109.
Deen TL, Fortney JC, Schroeder G. Patient acceptance of and initiation and engagement in telepsychotherapy in primary care. Psychiatr Serv. 2013;64(4):380–4. https://doi.org/10.1176/appi.ps.201200198.
Knowles SE, Toms G, Sanders C, Bee P, Lovell K, Rennick-Egglestone S, et al. Qualitative meta-synthesis of user experience of computerised therapy for depression and anxiety. PLoS One. 2014;9(1):e84323. https://doi.org/10.1371/journal.pone.0084323.
Deady M, Johnston D, Milne D, Glozier N, Peters D, Calvo R, et al. Preliminary effectiveness of a smartphone app to reduce depressive symptoms in the workplace: feasibility and acceptability study. JMIR Mhealth Uhealth. 2018;6(12):e11661. https://doi.org/10.2196/11661.
Walsh S, Kaselionyte J, Taylor SJ, Priebe S. What might affect acceptability of online positive psychology interventions for depression: a qualitative study on patient expectations. BMC Psychiatry. 2018;18(1):240. https://doi.org/10.1186/s12888-018-1812-x.
Bylsma LM, Morris BH, Rottenberg J. A meta-analysis of emotional reactivity in major depressive disorder. Clin Psychol Rev. 2008;28(4):676–91. https://doi.org/10.1016/j.cpr.2007.10.001.
Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res. 2015;17(1):e30. https://doi.org/10.2196/jmir.4055.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. https://doi.org/10.1191/1478088706qp063oa.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57. https://doi.org/10.1093/intqhc/mzm042.
Marshall MN. Sampling for qualitative research. Fam Pract. 1996;13(6):522–6. https://doi.org/10.1093/fampra/13.6.522.
Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Pol Ment Health. 2015;42(5):533–44. https://doi.org/10.1007/s10488-013-0528-y.
Guest G, Namey E, Taylor J, Eley N, McKenna K. Comparing focus groups and individual interviews: findings from a randomized study. 2017;20(6):693–708.
Kvale S, Brinkmann S. Interviews: learning the craft of qualitative research interviewing: sage; 2009.
Wärnestål P, Nygren J. Building an experience framework for a digital peer support service for children surviving from cancer. In: Proceedings of the 12th International Conference on Interaction Design and Children: 2013:ACM; 2013. p. 269–72.
Engdahl P, Svedberg P, Lexén A, Bejerholm U. Role of a Digital Return-To-Work Solution for Individuals With Common Mental Disorders: Qualitative. Study of the Perspectives of Three Stakeholder Groups. JMIR Form Res. 2020;4(9):e15625.
Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions—A systematic review. Internet Interv. 2014;1(4):205–15.
Ricciardi W. Assessing the impact of digital transformation of health services: Opinion by the Expert Panel on Effective Ways of Investing in Health (EXPH). Eur J Pub Health. 2019;29(Supplement_4):ckz185–769.
Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health. 2017;4(2):e19. https://doi.org/10.2196/mental.7785.
Strid C, Andersson C, Forsell Y, Öjehagen A, Lundh LG. Internet-based cognitive behaviour therapy and physical exercise–effects studied by automated telephone assessments in mental ill-health patients; a randomized controlled trial. Br J Clin Psychol. 2016;55(4):414–28. https://doi.org/10.1111/bjc.12111.
Stjernswärd S, Hansson L. Care S: Outcome of a web-based mindfulness intervention for families living with mental illness–A feasibility study. Inform Health Soc Care. 2017;42(1):97–108.
Ware LJ, Williams S, Bradbury K, Brant C, Little P, Hobbs F, et al. Exploring weight loss services in primary care and staff views on using a web-based programme. Inform Prim Care. 2012;20(4):283–8. https://doi.org/10.14236/jhi.v20i4.18.
Schwartz B. Self-determination: the tyranny of freedom. Am Psychol. 2000;55(1):79–88. https://doi.org/10.1037/0003-066X.55.1.79.
Flood D, Harrison R, Iacob C, Duce D. Evaluating mobile applications: a spreadsheet case study. Int J Mobile Hum Comp Interaction (IJMHCI). 2012;4(4):37–65. https://doi.org/10.4018/jmhci.2012100103.
Eldh A-C, Almost J, DeCorby-Watson K, Gifford W, Harvey G, Hasson H, et al. Clinical interventions, implementation interventions, and the potential greyness in between -a discussion paper. BMC Health Serv Res. 2017;17:16. https://doi.org/10.1186/s12913-016-1958-5.
Elwyn G, Nelson E, Hager A, Price A. Coproduction: when users define quality. BMJ Qual Saf. 2020;29(9):711–6. https://doi.org/10.1136/bmjqs-2019-009830.
Batalden M, Batalden P, Margolis P, Seid M, Armstrong G, Opipari-Arrigan L, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25(7):509–17. https://doi.org/10.1136/bmjqs-2015-004315.
Denise F. Polit, Cheryl Tatano Beck. Generalization in quantitative and qualitative research: myths and strategies. Int J Nurs Stud. 2010;47(11):1451–8.
We thank the respondents for their participation in this study, which made this research possible.
The Swedish Research Council for Health, Working Life and Welfare (FORTE) funded the study (Dnr 2016–07420). FORTE was not involved in the design, collection, analysis or writing of the manuscript. Open Access funding provided by Lund University.
Ethics approval and consent to participate
This study is part of a larger mWorks research project for which ethical approval was provided by Lund University from the Regional Ethics Committee, Sweden (application number 2017/324). Participants gave written informed consent and the study was performed in accordance with the ethical principles of the Helsinki Declaration of medical subjects including humans.
Consent for publication
The authors declare that they have no competing interests.
About this article
Cite this article
Engdahl, P., Svedberg, P. & Bejerholm, U. Acceptability of a digital return-to-work intervention for common mental disorders: a qualitative study on service user perspectives. BMC Psychiatry 21, 384 (2021). https://doi.org/10.1186/s12888-021-03386-w
- Return to work
- Mental health
- Digital solution
- Vocational rehabilitation