- Study protocol
- Open Access
- Open Peer Review
A blended face-to-face and smartphone intervention for suicide prevention in the construction industry: protocol for a randomized controlled trial with MATES in Construction
© The Author(s). 2019
- Received: 30 November 2018
- Accepted: 6 May 2019
- Published: 14 May 2019
Construction workers are at elevated risk of suicide. MATES in Construction (MATES) is one of the few suicide prevention programs that explicitly address this problem. The MATES program includes an integrated system of services that supports prevention, early intervention and recovery (i.e., primary, secondary and tertiary prevention) for mental health problems among construction workers. In this protocol, we describe a proposed evaluation of MATESmobile, an electronic platform which will be accessed by workers who have undergone MATES training.
In this protocol, we describe a Randomised Controlled Trial (RCT) which seeks to assess whether MATESmobile results in improved literacy regarding suicide prevention, and improved help-seeking and help-offering attitudes among those who have attended MATES training. Secondary outcomes include changes in suicide ideation, suicide attempt and psychological distress. Workers will be recruited prior to MATES face-to-face training. In total, 295 workers will be randomly assigned to the intervention condition (MATESmobile + face-to-face training) and 295 will be randomly allocated to the control (face-to-face training). The intervention will run for 8 weeks. Assessments will be run immediately post intervention, and at 3, 6, and 12 months
MATESmobile offers the potential to reinforce and enhance the effects of face-to-face training, resulting in greater skills and knowledge in suicide prevention, as well as a reduction in suicidality and distress.
This trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12619000625178; 26 April 2019).
- Mental health
- Suicide prevention
Elevated rates of suicide among construction workers have been identified in many countries , including Australia . Such elevated rates among construction workers may reflect a range of factors connected to employment in a highly-male dominated workforce, including excessive alcohol consumption, relationship problems, and lack of help-seeking [3, 4]. Aside from this, workers in construction also face a number of adverse psychosocial working conditions , including low job control and high psychological demands (the combination of which produces job strain) , low social support , and work-family conflict (when role pressures from the work and family domains are mutually incompatible) . There are constant shifts in the landscape and organisation of construction work, as tasks, colleagues and supervisors change from project to project and job to job, contributing to feelings of job insecurity . Adding to this instability is the fact that many workers are forced to meet short deadlines and experience periods of unemployment between projects . The lowest skilled groups may be at most risk, especially during times of economic recession .
“Connector training” for volunteer “gatekeepers”: Connectors help an at-risk worker access help via a trained worker, MATES Field Officer, Case Manager or other local community supports.
Suicide First Aid: in which Applied Suicide Intervention Skills Training (ASIST) trained workers provide suicide first aid interventions for at-risk workers identified by Connectors.
Field Officers: Field Officers are employed directly by MATES. Their job is to increase awareness, recruit new construction sites, and provide ongoing support to MATES sites through fortnightly site visits, establishing and maintaining relationships with workers on-site, and debriefing Connectors.
Case managers: Suitably qualified case managers are employed to assist troubled workers with a plan to effectively address their issue(s). This could include connecting workers with such services as their EAP, financial counselling, drug and alcohol services, grief counselling, or family and relationship counselling.
Thus, MATES provides an integrated health service model aimed at prevention, early intervention, and recovery (i.e., primary, secondary and tertiary prevention).
Since its inception, MATES has been committed to evaluation and continual program improvement. A recent evaluation  compared age-standardised suicide rates among the construction industry to other employed males. There was evidence of a decline in suicide rates among construction workers employed in the state of Queensland (where there has been a high uptake of MATES) compared to other employed males. In 2011, another evaluation  assessed process related outcomes, for example, how prepared participants felt to deal with someone who was suicidal, and attitudes towards suicide. Compared to 355 workers at two sites who had not completed GAT, those who received the training showed greater improvements in knowledge about suicide.
Several other uncontrolled evaluations have also suggested that MATES is an acceptable and appropriate intervention for workers in the construction industry [13–16]. The main limitations of these evaluations are that they only assessed knowledge immediately before and after training, and therefore could not provide information on whether MATES resulted in greater retention of knowledge in the long term. Thus, this finding may reflect transient “training effects” – where an individual retains knowledge immediately post training but loses it over time. Another problem is that these evaluations were conducted in one state only, and the findings may therefore not be generalisable to other states. Lastly, these evaluations did not assess the extent to which training reduced suicide attempts and thoughts of suicide among construction workers. Thus, several questions remain about the extent to which those who take part in the program experience individual changes in relevant outcomes proximal to suicide death, such as suicide ideation, self-harm or suicide attempt, and psychological distress. Further, and most specific to this project, questions remain about the longer-term impacts of the program, and whether it would achieve better outcomes if strengthened and reinforced by additional elements.
To fill the gaps in knowledge noted above, MATES has recently developed MATESmobile, an electronic platform which was designed to follow MATES face-to-face GAT training. MATESmobile seeks to enhance and sustain the effectiveness of MATES through a smartphone approach, which we will evaluate in relation to a wider range of outcomes than assessed previously. MATESmobile will focus on two main elements: 1) reinforcing face-to-face training messages over time, and; 2) enabling links to mental health support should people need it. The use of a smartphone approach to deliver this program is feasible and appropriate considering the high uptake of smart phones the construction industry, where they are considered a ‘tool of trade’.
In this paper, we describe the randomised controlled trial to test the efficacy of MATESmobile. The evaluation seeks to evaluate the potential gains of complementing MATES face-to-face training with MATESmobile. MATESmobile will be implemented by MATES, with support from the research team named in this project. This trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12619000625178; 26 April 2019).
The day-to-day management and administration of MATESmobile (including recruitment, roll out of intervention, and dissemination and collection of survey information) will be the responsibility of MATES.
This ongoing contact will reinforce messages from MATES, aiming to increase knowledge and skills in suicide prevention literacy, as well as more helpful attitudes about the extent to which suicide is preventable. The reinforcement of messages will also flow through to impact help offering (e.g., the message “MATES help other MATES”) and also help-seeking from either formal (e.g., doctors, mental health professionals, case management) or informal sources (e.g., peer support from co-workers, friends and family). At the same time, the MATESmobile platform will provide informational resources for those in need or at risk of suicide, including how to access to case management and other health services. It also seeks to encourage social support and community around the MATES program, leading to improvements in psychosocial safety at work. Collectively, all these aspects of the program are hypothesized to lead to improvements in primary and secondary outcomes.
The content of MATESMobile was designed by the founding organisation of the MATES program, including the National and State Chief Executive Officers and field staff. Staff employed at MATES were consulted to design program materials that were relevant and appropriately framed for the industry. This included input into the frequency and timing of content delivery, as well as the attractiveness, clarity, and usefulness of the content.
The study will be set in construction sites across Australia. These sites will include those managed by the Industry Partners involved in the study (who are Australia’s leading construction companies), and/or sites where MATES is operational.
Participants need to be recruited from a site where MATES is operational. Workers attending GAT will be considered eligible for the study.
Study objectives and outcomes
The primary objective of the evaluation is to assess whether MATESmobile: a) improves suicide prevention literacy, as measured by the GAT suicide awareness questionnaire ; and b) improves help-seeking and help-offering attitudes, as measured by the General Help-Seeking Behaviour Questionnaire , and the GAT help-seeking and help-offering items. Secondary aims are to assess whether MATESmobile results in greater reduction in suicide ideation as measured by the 4-item Suicidal Behavior Questionnaire-Revised (SBQ-R)  as well as psychological distress, as measured through the Kessler-6 . Changes in suicide attempt will be measured as an exploratory outcome (anticipating a potential low incidence of this outcome).
Training of field officers
There will be a standardised recruitment procedure across different construction sites. The research team will ensure that MATES field staff are well informed about both the program, and how to explain it to potential participants. The MATES Project Manager will train field officers about how to introduce and recruit participants to the study.
After completion of standard GAT face-to-face training, those allocated to the MATESmobile program will be contacted via smartphone application every two weeks for 8 weeks with information about how to access the program and reminders. We will conduct baseline assessment (a longer survey) prior to the 8 week intervention, followed by smaller assessments at 3, 6 and 12 months.
Those in the control arm will complete a baseline survey, GAT training, and additional surveys at 3, 6 and 12 months following baseline.
Recruitment of participants
Information about MATESmobile will be communicated at the start of GAT by MATES field officers, prior to the delivery of the GAT content. Field officers will provide information on the project including plain language statements and the procedure for providing consent. Those who are interested in the project will be asked to complete a written baseline survey, a written consent form and provide their mobile phone number. These will be placed in a sealed cardboard box during GAT, and will be returned to the project manager at MATES. The field officers will assure participants that this identifying information will not be provided to employers or released to any other party, and that results from the study will only be available in aggregate form, with no identifying information revealed. No participants have been recruited to the trial at this time.
Ethics and provision of care
All enrolled participants will be required to provide written consent to being involved in MATESmobile. If any person is identified as being at risk of suicide at the time of GAT or at a later time (identified through the survey items, e.g., the SBQ-R ), they will be offered connection to MATES case management and other suicide prevention help-lines, irrespective of which condition they are allocated to.
Sample size and power calculations
Previous work on examining suicide prevention literacy in construction workers using MATES  found a mean difference of 0.429 on a scale of one to five in beliefs about suicide warning signs at post-intervention. Based on this, a minimum of 295 participants per group will be required to detect this difference at the nominal 0.05 significance level with 90% power. A previous study has shown that 13% of the working population report suicide ideation . We believe it is realistic to expect a change from 13 to 8% prevalence following the trial. Power calculations indicate we will need 267 persons per group to detect this difference at the nominal 0.05 significance level with 90% power. Assuming 30% drop-out, we therefore aimed to recruit a total of 844 participants over a three-month period.
Participants in both conditions will complete online surveys (following the written baseline survey), which will be delivered to their smart phone via “alerts”. The “alerts” will re-direct respondents to an online survey. The surveys will be confidential, but not anonymous, as we will need to link baseline to follow up surveys, which will be done using mobile telephone numbers. Identifying information will also enable personalised re-contacts for non-response (which may be conducted via email and/or text messaging). The app will be available on Android, iOS and Windows mobile systems.
Allocation concealment will be achieved by generating a set of computerised random numbers which will be assigned to participants. We will randomise in blocks of 50 participants. Hence, once 50 persons have returned their consent form, they will be allocated a random number. Once a block of 50 participants is obtained, the random numbers will be sent to a statistician external to the trial for allocation (discussed below).
Those involved in the design and evaluation of the trial will be blinded to participants’ allocation status. It is not possible to blind participants to the conditions they are allocated to. Nor is it possible to blind the project manager, who will be based at MATES.
The project manager will enrol participants. The statistician will generate the allocation sequence and assign participants to intervention or control conditions following randomisation.
Participation numbers will be provided to a statistician external to the trial who will randomise participants into either the MATESmobile condition or control condition (MATES face-to-face only). The statistician will generate the allocation sequence for randomisation using a computer-based randomisation algorithm. The statistician will not reveal which of the participants are allocated to the intervention or control conditions to those involved in the design and evaluation process.
Socio-demographic data (e.g., age, sex, educational level) will be collected using the standard survey questions as collected by the Australian Bureau of Statistics . Suicide prevention literacy will be assessed with the GAT suicide awareness questionnaire, which asks about suicide knowledge, attitudes, and behaviours ; help-seeking and help-offering will be assessed with the General Help-Seeking Questionnaire  and the GAT help-seeking and help-offering items. Psychological distress will be measured using the Kessler-6 instrument ; psychosocial risks in the workplace will be assessed using the Psychosocial Safety Climate (PSC-12) ; and suicidal ideation and behaviours will be assessed using the revised version of the Suicidal Behavior Questionnaire-Revised .
User engagement metrics will be recorded via the app. Information such as: i) number of times engaged with the app; ii) time spent using the app per session; and iii) number of pages viewed per session, will be recorded. Additionally, participants will be asked to respond to survey questions regarding their experience of the app, such as: i) what did you like about MATESmobile?; ii) what do you think could be improved about MATESmobile?; iii) would you recommend MATESmobile to a colleague/friend? These questions will be sent to participants following their completion of the final survey.
Data management and monitoring
Data will be obtained from: a) written responses to a baseline paper survey; b) electronic responses to post-baseline surveys. Responses to the baseline data survey will be entered into an electronic file (e.g., Microsoft excel) by the Project Manager based at MATES, who will enter this data twice to ensure accuracy. The paper files will be stored in a locked cabinet only accessible by the Project Manager. The Project Manager will assign a participant identifier (based on the mobile phone number that the participant provides). Once participants are allocated to an intervention or control condition, the research team will be sent the baseline data file electronically via a secure server.
The remaining surveys will be completed electronically via smartphones, and captured using an electronic survey platform. The Project Manager will have access to this survey platform and will monitor responses to the survey. The Project Manager will be able to link baseline survey information to follow up surveys using the mobile phone number provided by the participants. There will be an inbuilt prompt within MATESmobile which will be sent to participants to remind them to complete surveys. This will be sent 2 days after the survey is initially sent. Following this, two other messages will be sent to prompt participants to complete the survey on the third day and then again on the fourth day. On the seventh day, the Project Manager will phone participants and ask them to complete the survey. A data monitoring committee was not required by the Ethics Committee for this trial as the risk of harm to participants is negligible.
Analyses of continuous outcomes will be undertaken on an intent-to-treat basis, including all participants randomised, regardless of treatment actually received or withdrawal from the study. Mixed-model repeated measures (MMRM) analyses will be used because of the ability of this approach to include participants with missing data without using correction biased techniques, such as last observation carried forward . This approach can also accommodate and assess the strength and significance of clustering effects, enabling us to model cohort effects (including training time and location) using random effects within the MMRM models. For binary outcomes (prevalence of suicidal ideation) and skewed outcomes (severity of suicidal thoughts and behaviours), a comparable modelling approach will be used that accounts for binary and ordinal outcomes. Process evaluation will be analysed using descriptive statistics; for example, the average amount of time spent using the app during each session will be assessed. Responses to the process survey, sent to participants following completion of the trial, will be examined. The mean and frequency of quantitative responses will be calculated, and content analysis of qualitative responses will occur. Quantitative analyses will be undertaken in Stata for Windows, version 15 .
Ethics and dissemination
Ethical approval has been granted by the University of Melbourne (ID: 1852200). Important protocol modifications will be communicated to the research team, the ethics committee and participants. As mentioned above, written informed consent will be obtained from participants at the time they complete the baseline survey. The authors declare no conflicts of interest. A plain language report on the results of the trial will be publicly available on the MATES website following completion of the evaluation study. Outcomes of the study will also be communicated in academic journal articles and conference presentations. Authors on all publications will be required to meet the academic authorship guidelines.
Suicide among construction workers continues to be unacceptably high in Australia, as in many areas of the world. MATES is one of the few workplace suicide prevention programs attempting to tackle the high burden of suicide in this occupational group. Importantly, it is among the few workplace suicide prevention program for which there is any evidence of effectiveness . However, there are still much to be learned about MATES, including whether training effects persist over time, and whether the program has effects on proximal risk factors for suicide, such as suicide ideation, suicide attempts and psychological distress. We hope that the MATESmobile trial will begin to fill some of these gaps in current knowledge, and provide evidence for the effectiveness of a new, highly accessible smartphone app that can be rapidly disseminated throughout the construction industry.
Online and electronic interventions have been shown to be effective in reducing stigmatising attitudes towards depression , enhancing knowledge about evidence-based treatment, promoting help-seeking from family and friends , and improving knowledge about symptoms of depression and anxiety . However, their effectiveness in enhancing knowledge about suicide prevention, suicide ideation, and self-harm is mixed . Researchers acknowledge that online interventions are most effective when supported by strategies that: allow users to tailor activities to their context; reduce attrition; and promote ongoing use . This presents a clear rationale for an approach that makes use of both online and face-to-face mechanisms (i.e. a blended approach). In this study, we will assess the potential gains that can be made by supplementing a multi-level workplace suicide prevention program with smartphone technology, which will allow MATES to keep in contact with participants over time and as they move from site to site.
Aside from testing the effectiveness of MATESmobile, the Project offers the opportunity for considerable capacity-building between health service provider MATES, and the Partner Organisations who are supporting the project; all of whom view MATESmobile as a platform for extending their activities to other aspects of workplace health and wellbeing. MATESmobile has a multitude of potential future applications and uses, including being a way of connecting and supporting men and women in the construction industry long term, and thereby creating a community of advocates for suicide prevention.
Funding provided by NHMRC Partner Project APP1134499, MATES and Cbus. Industry support provided by CPB, Lendlease, Brookfield Multiplex, and Cbus. MATES was involved in the design of the evaluation. The funders and industry supporters will have no role in data analysis or interpretation of results, but will aid in data collection. Manuscripts will be sent to MATES for comment. For comments to be incorporated, responses will need to be provided to the study team one month before submission to a given academic journal.
PJB is supported by NHMRC fellowship 1083311. AM is supported by a Victorian Health and Medical Research Fellowship.
Availability of data and materials
The study was designed by AM, ADL, JG and CL. All authors contributed to and approved the design. The specific trial protocol was designed by AM, JG, CL, AJS and. TLK. AM, AJS and TLK wrote the manuscript. All authors contributed to drafts of the manuscript and approved the final version.
Ethics approval and consent to participate
Ethical approval has been granted by the University of Melbourne (ID: 1852200).
Consent for publication
The authors declare no conflicts of interest. JG and CL are employed as Chief Executive Officer (Queensland & Northern Territory) and Chief Executive Officer (National) of MATES in Construction, respectively.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Milner A, Spittal MJ, Pirkis J, LaMontagne AD. Suicide by occupation: systematic review and meta-analysis. Br J Psychiatry. 2013;203(6):409–16.PubMedView ArticleGoogle Scholar
- Milner AJ, Niven H, LaMontagne AD. Occupational class differences in suicide: evidence of changes over time and during the global financial crisis in Australia. BMC Psychiatry. 2015;15(1):223.PubMedPubMed CentralView ArticleGoogle Scholar
- Gullestrup J, Lequertier B, Martin G. MATES in construction: impact of a multimodal, community-based program for suicide prevention in the construction industry. Int J Environ Res Public Health. 2011;8(11):4180–96.PubMedPubMed CentralView ArticleGoogle Scholar
- Heller TS, Hawgood JL, Leo DD. Correlates of suicide in building industry workers. Arch Suicide Res. 2007;11(1):105–17.PubMedView ArticleGoogle Scholar
- Loosemore M, Waters T. Gender differences in occupational stress among professionals in the construction industry. J Manag Eng. 2004;20(3):126–32.View ArticleGoogle Scholar
- Goldenhar LM, Williams LJ, Swanson NG. Modelling relationships between job stressors and injury and near-miss outcomes for construction labourers. Work Stress. 2003;17(3):218–40.View ArticleGoogle Scholar
- Janssen PPM, Bakker AB, de Jong A. A test and refinement of the demand-control-support model in the construction industry. Int J Stress Manag. 2001;8(4):315–32.View ArticleGoogle Scholar
- Lingard H, Francis V. Does work–family conflict mediate the relationship between job schedule demands and burnout in male construction professionals and managers? Constr Manag Econ. 2005;23(7):733–45.View ArticleGoogle Scholar
- Sobeih TM, Salem O, Daraiseh N, Genaidy A, Shell R. Psychosocial factors and musculoskeletal disorders in the construction industry: a systematic review. Theor Issues Ergon Sci. 2006;7(3):329–44.View ArticleGoogle Scholar
- Milner A, Niven H, LaMontagne A. Suicide by occupational skill level in the Australian construction industry: data from 2001 to 2010. Aust N Z J Public Health. 2014;38(3):281–5.PubMedView ArticleGoogle Scholar
- The Department of Health: 3.3 National suicide prevention strategy. Accessed from http://www.health.gov.au/internet/publications/publishing.nsf/Content/suicide-prevention-activities-evaluation~background~national-suicide-prevention-strategy on the 23rd October 2018: Australian Government; 2016.
- Doran CM, Ling R: The economic cost of suicide and suicide behaviour in the NSW construction industry and the impact of MATES in construction suicide prevention strategy in reducing this cost. Spring Hill QLD 4004: Mates in construction; 2014.Google Scholar
- Banks C. MATES in construction: ASIST workers survey report. Brisbane: Cate Banks consulting; 2013.Google Scholar
- Barletta J, Dundas V. A report on the development of a Life skills program for construction apprentices. The Grange, Qld: The Grange Practice; 2012.Google Scholar
- Construction Mi. Life skills course – pilot project evaluation. Brisbane: Arkaen; 2011.Google Scholar
- Research FM: MATES in construction: program evaluation, report of findings Brisbane: footprints market Research; 2012.Google Scholar
- Chan A-W, Tetzlaff JM, Altman DW, Laupacis A, Gøtzsche PC, Krleža-Jerić K, Hróbjartsson A, Mann H, Dickersin K, Berlin JA, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.PubMedPubMed CentralView ArticleGoogle Scholar
- Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DW, Mann H, Berlin JA, Dickersin K, Hróbjartsson A, Schulz KF, Parulekar WR, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.PubMedPubMed CentralView ArticleGoogle Scholar
- Wilson CJ, Deane FP, Ciarrochi JV, Rickwood D. Measuring help seeking intentions: properties of the general help seeking questionnaire. Can J Couns. 2005;39(1):15–28.Google Scholar
- Osman A, Bagge C, Gutierrez P, Konick L, Kopper B, Barrios F. The suicidal behaviors questionnaire-revised (SBQ-R): validation with clinical and non-clinical samples. Assessment. 2001;8:445–55.View ArticleGoogle Scholar
- Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, Howes MJ, Normand SL, Manderscheid RW, Walters EE, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184–9.PubMedView ArticleGoogle Scholar
- King TL, Gullestrup J, Batterham PJ, Kelly B, Lockwood C, Lingard H, Harvey SB, LaMontagne AD, Milner A. Shifting beliefs about suicide: pre-post evaluation of the effectiveness of a program for Workers in the Construction Industry. Int J Environ Res Public Health. 2018;15(10):2106.PubMed CentralView ArticleGoogle Scholar
- Milner A, Page KM, LaMontagne AD. Perception of mattering and suicide ideation in the Australian working population: evidence from a cross-sectional survey. Community Ment Health J. 2016;52(5):615–21.PubMedView ArticleGoogle Scholar
- ABS. Labour Force, Australia, Aug 2015. Cat. No. 6202.0. Canberra: Australian Bureau of Statistics; 2015.Google Scholar
- Hall GB, Dollard MF, Coward J. Psychosocial safety climate: development of the PSC-12. Int J Stress Manag. 2010;17(4):353.View ArticleGoogle Scholar
- Verbeke G. Linear mixed models for longitudinal data. New York, NY: Springer; 2000.Google Scholar
- StataCorp. Stata Statistical Software: Release 15. College Station, TX: StataCorp LP; 2017.Google Scholar
- Milner A, Page K, Spencer-Thomas S, Lamotagne AD. Workplace suicide prevention: a systematic review of published and unpublished activities. Health Promot Int. 2015;30(1):29–37.PubMedView ArticleGoogle Scholar
- Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C. Effect of web-based depression literacy and cognitive–behavioural therapy interventions on stigmatising attitudes to depression. Randomised Controlled Trial. 2004;185(4):342–9.Google Scholar
- Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ (Clinical research ed). 2004;328(7434):265.View ArticleGoogle Scholar
- Proudfoot J, Clarke J, Birch M-R, Whitton A, Parker G, Manicavasagar V, Harrison V, Christensen H, Hadzi-Pavlovic D. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013;13(1):312.PubMedPubMed CentralView ArticleGoogle Scholar
- Witt K, Spittal MJ, Carter G, Pirkis J, Hetrick S, Currier D, Robinson J, Milner A. Effectiveness of online and mobile telephone applications (‘apps’) for the self-management of suicidal ideation and self-harm: a systematic review and meta-analysis. BMC Psychiatry. 2017;17(1):297.PubMedPubMed CentralView ArticleGoogle Scholar
- Bennett GG, Glasgow RE. The delivery of public health interventions via the internet: actualizing their potential. Annu Rev Public Health. 2009;30:273–92.PubMedView ArticleGoogle Scholar