Skip to main content
Download PDF

What’s wrong with John? a randomised controlled trial of Mental Health First Aid (MHFA) training with nursing students

BMC Psychiatry volume 17, Article number: 111 (2017) Cite this article

Abstract

Background

The prevalence of mental health problems have been found to be higher among university students compared to their non-student peers. Nursing students in particular face a range of additional stressors which may impact their undergraduate performance and their careers. Mental Health First Aid (MHFA) aims to increase mental health literacy and to reduce stigma and may positively impact on the student population. This paper describes a MHFA randomised controlled trial targeting nursing students at a large Australian university. This study aimed to measure the impact of the MHFA course on mental health literacy, mental health first aid intentions, confidence in helping someone with a mental health problem and stigmatising attitudes including social distance.

Methods

Participants were first year nursing students (n = 181) randomly allocated to the intervention (n = 92) or control (n = 89) group. Intervention group participants received the standardised MHFA course for nursing students. Online self-report questionnaires were completed at three time intervals: baseline (one week prior to the intervention: T1) (n = 140), post intervention (T2) (n = 120), and two months post intervention (T3) (n = 109). Measures included demographics, mental health knowledge, recognition of depression, confidence in helping, mental health first aid intentions and stigmatising attitudes including social distance. Repeated measures ANOVA was computed to measure if the impact of time (T1, T2, T3) and group (intervention and control) on the outcome variables.

Results

There was a significant improvement among intervention compared to control group participants across the three time periods for knowledge scores (p < 0.001), confidence in helping (p < 0.001), mental health first aid intentions (p < 0.001), total personal stigma (p < 0.05), personal dangerous/unpredictable stigma (p < 0.05) and social distance (p < 0.05) scores.

Conclusion

MHFA is useful training to embed in university courses and has the potential to enhance mental health literacy and reduce stigmatising attitudes and social distance. While this course has particular salience for nursing and other health science students, there are broader benefits to the general university population that should be considered and opportunities accordingly explored for all students to complete the course.

Trial registration

Australian New Zealand Clinical Trials Registry ACTRN12614000861651. Retrospectively registered 11 August 2014.

Peer Review reports

Background

The burden of poor mental health in Australia is substantial, with almost half of Australians developing a mental illness at some point in their life [1]. Poor mental health can have long term impact across the lifespan, affecting educational achievement, social interactions, employment and contribution to community [1, 2]. In addition, poor mental health is associated with substance misuse, increased risk of violence and poor reproductive and sexual health [1, 2]. Mental health problems are most likely to manifest before the age of 25 years [1] representing the age period for the majority of undergraduate university students [3].

Mental health in university students

Australian university students report higher levels of psychological distress than their non-student peers [4], and face unique mental health issues [5–7]. A systematic review (n = 24 studies) found a weighted mean prevalence of depression of 30.6% among undergraduate university students [8]. Financial strain and lower socio economic status, being in first or second year of study, being female, and living off campus or alone increases the risk of poorer mental health outcomes for students [4, 5, 7, 9, 10]. Poor mental health can have a significant impact on educational and academic performance, student retention, and future employment [11–15] with one study for example finding a significant decrease in academic performance among students with diagnosed depression [16].

Uptake of mental health services among university students has been found to be poor, with one Australian study finding up to 84% of students that met criteria for depression (Patient Health Questionnaire-9) and anxiety (Patient Health Questionnaire anxiety module) did not access services [17]. Despite most students in the study having health insurance and access to a range of free services available on campus, reasons for lack of help seeking included scepticism about treatment, a perceived lack of need and lack of awareness of health care availability and insurance cover [17]. It is acknowledged that young people are less likely to seek help for mental health problems if they have negative attitudes towards seeking help, if they feel they should be able to resolve the issue themselves and if they are experiencing suicidal ideation [18]. Accessing help for mental health problems is recognised as a protective factor [18] with indicated and early intervention programs likely to be most beneficial to adolescents and young adults [18, 19].

Mental health and nursing students

Although nursing students face similar stressors to other tertiary students, additional factors have been identified which place them at risk for developing mental health problems [20]. Stress relating to academic and time pressures, high workloads, work placements and the responsibility and experience of patient care [20, 21] not only affect nursing students while at university but further, mental health issues experienced at an undergraduate level may negatively impact future careers [21]. Within the workplace nurses require continuous interaction with patients, family members and other health professionals in high stress environments [22]. Prolonged exposure to this type of work environment can negatively affect mental health which in turn may lead to absenteeism, high turnover of staff and burnout [23].

Mental health programs targeting nursing students have been found to positively influence their attitudes towards mental health, increase social supports and health literacy and decrease stigma [21, 24]. Utilising social supports has had a range of positive outcomes on the mental health of students including lowering stress; increasing coping mechanisms for stress; and promoting positive wellbeing [21]. An Australian study found structured programs examining mental health issues increased nursing students’ confidence and preparedness to respond to mental health issues [25]. Further, the program was found to better prepare students for the workplace and provided nurses with the ability to recognise the early signs and symptoms of mental illness amongst their colleagues and peers [23].

Building mental health literacy

There is a recognised need to enhance mental health literacy among the university population [6] and among allied health [26] and nursing students [24]. Mental health literacy has been identified as an important component of a nursing degree and it is recommended that it is introduced early in the course [24]. Targeting nursing students during their first year of university provides the opportunity to enhance mental health literacy and decrease stigma among nursing students, to provide a basis for further mental health courses within their degree and to enhance their support of peers who may be experiencing a mental health issue [27, 28].

Mental Health First Aid (MHFA) is an internationally recognised training course which provides participants with the skills to identify and support those who may be developing a mental health problem or in a mental health crisis [29]. The course has been identified as a potential intervention for health professionals including nursing, medical [27] and pharmacy students [26] and for other support services [30] to improve mental health literacy and increase the likelihood of providing mental health first aid to a peer experiencing a mental health problem. In 2013 the MHFA Australia’s Standard MHFA course was tailored to specifically target the needs of nursing and medical students, with the addition of an eating disorders component found in the Youth MHFA course (for adults working or living with adolescents) [27].

This paper describes the results of a pragmatic, waitlisted randomised controlled trial (RCT) to measure the impact of MHFA training with nursing students at a large university in Perth, Western Australia. This study adds to the growing literature regarding MHFA specifically for program targeting health professionals such as nursing students. Impact was assessed by mental health literacy measures including recognition of depression and knowledge of mental health issues [29], mental health first aid intentions, confidence in helping someone with a mental health problem and stigmatising attitudes including social distance. We hypothosized that participants in the intervention group would report higher levels of mental health literacy and mental health first aid intentions, greater confidence in helping and lower stigmatising attitudes scores compared to control group participants.

Methods

Participants

Eligible participants were first year undergraduate nursing students completing a practical unit (approximately n = 250); enrolled in the internal study mode; studying at the main campus; and aged 18 years or older. The university student intranet, an in-class presentation delivered by one of the research team members, and fliers were used to advertise the study. Participants were provided the MHFA course at no charge (control group participants were able to complete the online course after the T3 data collection period) and were able to use course participant for a portion of volunteer hours required for the practical unit. No other incentives were provided.

As the literature [29, 31] suggested a high correlation of 0.8 for the baseline-post measurements, it was necessary to have 50 students in each the intervention and the control group to detect 5% level of significance with 90% power in order to detect medium effect sizes in the outcome variables [28]. For the purpose of the power analysis mental health knowledge was selected as the key outcome variable. Based on the findings of Jorm et al. [29] a conservative 1.5 difference between baseline and post intervention knowledge scores was estimated. Participation in university studies has been found to be low [32, 33]. In order to ensure an adequate sample size for both the intervention and control groups at the completion of the study all undergraduate students enrolled in the designated unit (approximately n = 250) were invited to register interest. Students were advised of potential dates for the MHFA course and of the eligibility criteria hence reducing the likelihood of recruiting ineligible participants. A total of 200 students initially expressed interest in taking part in the study. The recruitment was influenced by the practicalities of working within a large university which required delivering the intervention during semester at a time convenient to university scheduling and clinical rotations for students (see Fig. 1).

Fig. 1
figure 1

Trial schema

Full size image

Procedure

After online registration of interest (n = 200) students who successfully completed registration and who were eligible (n = 181) were randomly assigned to either the intervention or control group using computer generated automated randomisation and were notified of their intervention condition (intervention n = 92; control n = 89). The computer generated randomisation and notification was implemented by a Research Assistant Consent was obtained from all participants at the beginning of the baseline questionnaire (intervention n = 59; control n = 81). Due to logistics involved in attending the face-to-face course and the need to provide volunteer hours for participation in the intervention in a specific unit during the university semester, participants were aware of allocation to intervention or control group at the time of completion of the baseline questionnaire. Consent was obtained from all participants at the beginning of the baseline questionnaire. More detail regarding the research methods can be found in the study protocol [28]. This study follows the CONSORT Guidelines [34] for the design and implementation of randomised controlled trials. This study was approved by the Curtin University Human Research Ethics Committee (SPH-74-2013).

The intervention

Intervention group participants received the tailored MHFA course for nursing students [28]. The training included: signs, symptoms and risk factors for common mental health problems, including depression, anxiety, substance use disorders, psychosis and eating disorders and strategies to assist someone experiencing a number of mental health crises [28]. Two face to face courses were delivered during semester by accredited MHFA facilitators. Each course comprised two-6.5 h sessions run over two days. All participants were provided the MHFA manual [35], standardised MHFA materials including specific materials designed for nurses. MHFA is a standardised course [36, 37], facilitated by accredited professionals therefore enhancing the fidelity of the course and reducing risk of Type 111 error [38]. The control group received no intervention during the data collection period (baseline: T1 to two months post intervention: T3). Once control group participants completed the T3 questionnaire they were offered the online version of the MHFA course. The online course was completed by 64 study participants within one month of T3 data collection.

Participants completed an online self-report questionnaire at three time intervals: baseline (one week prior to the intervention): (T1), post intervention (T2), and two months post intervention follow up (T3). Demographics questions were excluded in the post intervention and follow up questionnaires. Two months post intervention was selected for follow up data collection to work within the constraints of university semesters and clinical rotations. Four reminder emails were sent to non-completers over a two week period (see Fig. 1).

Measures

Data were collected to measure demographics, mental health knowledge, recognition of depression, confidence in helping, mental health first aid intentions and stigmatising attitudes including social distance.

Mental health knowledge, recognition of depression and confidence

Mental health knowledge was assessed using 20 statements for which students were asked to respond ‘true’ or ‘false’. These questions were adapted from previously validated MHFA knowledge statements [29]. A score (0–20) was computed with a higher score indicating better knowledge.

The questionnaire used the vignette described below to guide questions associated with recognition of mental health problems, confidence assisting with mental health, social distance, and personal and perceived stigma. The vignette was adapted from previous questionnaires [26, 29] and meets the diagnostic criteria set by the DSM-IV [39] and ICD-10 for major depression [40] and is described below:

John is a 21-year-old student who has been feeling unusually sad and miserable for the last few weeks. He is tired all the time and has trouble sleeping at night. John doesn’t feel like eating and has lost weight. He can’t keep his mind on his studies and his marks have dropped. He puts off making any decisions and even day-to-day tasks seem too much for him. His parents and friends are very concerned about him. John feels he will never be happy again and believes his family would be better off without him. John has been so desperate, he has been thinking of ways to end his life.

Similar to other studies [27] to measure recognition of depression participants were provided the vignette then asked an open-ended question “what, if anything is wrong with John?” Responses of ‘depressed’, ‘depression’, ‘affective disorder’ or ‘mood disorder’ signified a correct identification of John’s problem.

Mental health first aid intentions

Mental health first aid intentions was measured by an open-ended question which asked participants to: Imagine John is someone you have known for a long time and care about. You want to help him. What would you do? This was scored by a research assistant then ratified by three researchers using the scoring system described by Yap and Jorm [41]. This system is based on the ALGEE action plan which is a key focus of the MHFA course [35]. Responses may receive 0–2 points per component of the ALGEE (Approach the person; Assess and Assist with any crisis; Listen non-judgementally; Give support and information; Encourage appropriate professional help; and encourage other supports) (Total score 0–12) [42].

To assess confidence to assist someone with a mental health problem, participants were asked about their confidence in their ability to help John. Responses included a five point Likert scale ranging from: 1 (don’t know) to 5 (very confident) (Score 0–5).

Stigmatising attitudes

MHFA and other community-based studies have consistently used the Depression Stigma Scale (DSS) [43] and the Social Distance Scale (SDS) [44] to measure the constructs of stigmatising attitudes. While the DSS measures beliefs about people with mental health illnesses, the SDS measures intended avoidance behaviour [45]. As for other studies [27, 45, 46], due to the complexity of measuring these constructs this study measured personal and perceived stigma and social distance.

Personal and perceived stigma were measured using a seven item scale which was adapted from the validated Depression Stigma Scale (DSS) [43]. Respondents were asked two sets of questions, the first about their personal feelings towards John and the second about their perception of others’ feelings towards John. Consistent with other MHFA studies [46] some questions were excluded, for example, voting for John as a politician, and the wording was modified. Personal stigma statements included: ‘John could make himself better if he wanted,’ ‘John’s problem is a sign of personal weakness,’ ‘John’s problem is not a real medical illness,’ ‘John is dangerous,’ ‘It is best to avoid John so that you don’t develop this problem yourself,’ ‘John’s problem makes him unpredictable,’ and ‘You would not tell anyone if you had a problem like John’s’. Responses were scored on a five point Likert scale from “strongly agree” to “strongly disagree”. The perceived stigma questions used the same questions, response items and scoring method however participants were asked to consider ‘what you think most other people believe’. Personal and perceived stigma scores were computed and divided by seven with higher scores representing lower stigmatising attitudes.

Social distance was measured by a scale adapted from the previously validated Social Distance Scale (SDS) [44] and used in other MHFA studies [27, 46]. Participants were asked to respond to five statements asking how they would feel spending time with John. A five point Likert scale was used with responses ranging from “definitely not” through to “definitely”. Students were asked if they would be happy to ‘go out with John on the weekend’, ‘to work on a project with John,’ ‘to invite John around to your house,’ ‘to go to John’s house,’ and to ‘develop a close friendship with John’. Scores were computed then divided by 5 to derive a mean [44] with higher scores representing less social distance and lower stigmatising attitudes [47].

Data analysis

A Principal Component Analysis with varimax rotation was employed to reduce stigma and social distance items. Previous studies have employed Principal Component Analysis [29] and Exploratory Structural Equational Modelling [45] to reduce stigma and social distance items. While components are similar across studies there is some variation. For example, the study by Jorm and Wright [46] included a ‘social distance’, ‘stigma perceived in others’, ‘dangerous and unpredictable’ and a ‘weak-not sick’ component. A fifth component ‘reluctance to disclose’ which included the single item ‘you would not tell anyone if you had a problem like John’s’ was also included. A study by Yap et al. [45] also include a social distance component, in addition to ‘personal weak not sick’ ‘personal dangerous/unpredictable’, perceived weak not sick’ and perceived weak not sick’. Measuring personal and perceived stigma separately was seen to be important for community interventions [45]. Yap et al. [45] found the ‘reluctance to disclose’ item to load moderately on to the personal and the perceived ‘dangerous/unpredictable’ factors for the general community, but not for the youth survey. The personal and perceived items about ‘it is best to avoid people like John so you don’t develop this problem yourself’ to load only moderately onto both the ‘weak not sick’ and the ‘dangerous/unpredictable’ factors [45]. Others have also found weak but moderate loadings for this variable onto both of these factors [48]. This study found a weak moderate loading for the perceived but not for the personal stigma factors. In the initial analysis the addition of ‘it is best to avoid people like John so you don’t develop this problem yourself’ to the ‘perceived dangerous-not-weak’ factor did not alter the current findings for this factor. Reavley et al. [48] found ‘you would not tell anyone if you had a problem like John’s’ to load moderate onto dangerous/unpredictable. In contrast our study found a moderately significant loading onto ‘perceived weak not sick’ but no loading onto the personal factor. While there is some differentiation between some of the variables associated with the personal and perceived stigma items, the social distance items appear to consistently load relatively uniformly onto a single factor across studies [45, 46].

Based on the findings of others [45], and of the principal component analysis this study measured a social distance score, a total personal stigma and total perceived stigma score in addition to ‘personal weak-not-sick’, ‘personal dangerous/unpredictable’, ‘perceived weak-not-sick’ and ‘perceived dangerous/unpredictable’ scores. ‘Personal weak-not-sick’ included “John could make himself better if he wanted‘, ‘John’s problem is a sign of personal weakness’, ‘John’s problem is not a real medical illness’. ‘Personal dangerous/unpredictable’ included ‘John is dangerous’ and ‘John’s problem makes him unpredictable’. ‘Perceived weak-not-sick’ and ‘dangerous/unpredictable’ used the same items presented in relation to what the participant felt most other people believe. Social distance items loaded consistently as described above. The perceived stigma items ‘you would not tell anyone if you had a problem like John’s’ loaded moderately onto ‘perceived weak not sick’ and ‘it is best to avoid John so that you don’t develop this problem yourself’ loaded ‘moderately onto perceived dangerous/unpredictable’. However given the very moderate loading, and to ensure consistency with other studies [27] these items were not included in the final analysis of factors. Table 1 describes the Principal Component Analysis.

Table 1 Principal component factor analysis
Full size table

Chi square analysis was conducted to test associations of categorical variables between the intervention and control group. Intention to treat analyses were performed. Multiple imputation was used to impute variables for participants who completed baseline questionnaires but did not complete T2 and/or T3 questionnaire. Missing values were computed using baseline values. Repeated measures ANOVA was employed to determine if time (T1, T2 and T3) and group (intervention and control) had a significant effect on the outcome variables [38]. Between and within subject analyses were conducted. Results are reported considering the interaction between time and group. Partial eta squared was used to determine effect size. Data were analysed using SPSS Version 22. Significance level was set at 5%.

Results

A total of 200 nursing students registered for the trial and after initial drop out and removal of ineligible students (n = 19), 181 students were randomised into either the intervention (n = 92) or control (n = 89) group. The baseline questionnaire (T1) was completed by 140 participants (intervention n = 59; control n = 81). At follow up (T3), 22% of the sample was lost to attrition, providing a final sample of 109 (intervention N = 50; control n = 59). The final sample (T3) did not differ significantly according to age, gender, country of birth or domestic or international enrolment status to the participants at T1. Intervention and control group participants did not differ significantly on any demographics. There were no significant differences for demographics for participants lost to the study at T2 or T3 apart from gender. Males were proportionally more likely to be lost from the study at T2, however females were more likely to represent those lost at T3. Participant demographics are described in Table 2 and the trial schema in Fig. 1.

Table 2 Participant characteristics at baseline (n = 140)
Full size table

Knowledge

Knowledge scores were significantly higher for the intervention at T2 compared to the control group when T1, T2 and T3 were compared. Both between-subject (df = 1, F = 0.320, p < .001, η2 p  = 0.03. and within-subject differences were significant (df = 2, F = 21.00, p < .001, η2 p  = 0.132) when T2 and T3 knowledge scores were compared to T1 scores. The intervention group reported an increase in mean knowledge score from 11.76 (T1) to 14.69 (T2) with mean scores reducing very slightly at T3 (13.51) (Table 3).

Table 3 Changes in knowledge, confidence, stigmatising attitudes and social distance
Full size table

Confidence helping John

Intervention group participants reported significantly higher confidence scores both within (df = 2, F = 24.809; p < .001, η2 p  = 0.153) and between (df = 1, F = 23.551; p < .001, η2 p  = 0.149) subjects compared to the control group when T1 scores were compared with T2 and T3 scores (Table 3). Confidence in helping scores continued to increase among intervention group participants between T2 and T3.

Mental health first aid intentions

Intervention group participants were significantly more likely to report appropriate mental health first aid intentions towards helping John compared to the control group at T2 and T3 both (within-subjects: df = 2, F = 14.058, p < 0.01, η2 p  = 0.093; between-subjects: df = 1; F = 32.466, p < 0.01, η2 p  = 0.192). The intervention group reported an increase in mean mental health intention scores from 3.40 (T1) to 5.44 (T2) with mean scores reducing very slightly at T3 (4.93) (Table 3).

Stigmatising attitudes and social distance

There was a significant difference between groups and time s over the three time periods for personal stigma (df = 2, F = 4.929; p = 0. 008, η2 p  = 0.035) with participants from the intervention group reporting more positive levels of overall personal stigma at each time period compared to T1. Personal stigma scores continued to increase between T2 and T3 (Table 2). ‘Personal dangerous/unpredictable’ stigma scores also significantly increased indicating lower levels of stigma for intervention group participants at T2 and T3 compared to T1 in comparison to the control group (within-subjects: df = 2, F = 4.184; p = 0.016, η2 p  = 0.030; between-subjects: df = 1, F = 7.785; p = 0.006, η2 p  = 0.054). However there were no significant differences between intervention and control groups when T1 was compared to T2 and T3 for ‘personal weak-not-sick’ stigma (within-subjects df = 2, F = 2.227, p = 0.110, η2 p  = 0.003; between-subjects; df = 1, F = 0.040, p = 0.842, η2 p  = 0.000). Similarly there was no significant differences between group and time for perceived stigma (within-subjects: df = 2, F = 1.825; p = 0.163, η2 p  = 0.013; between-subjects: df = 1, F = 1.401; p = 0.239, η2 p  = 0.010), ‘perceived weak-not-sick’ (within-subjects: df = 2, F = 2.7549; p = 0.0654, η2 p  = 0.020; between-subjects: df = 1, F = 2.817, p = 0.096, η2 p = 0.020) or ‘perceived dangerous/unpredictable’ stigma scores (within-subjects: df = 2, F = 1.405; p = 0.247, η2 p  = 0.010; between-subjects: df = 1, F = 0.022; p = 0.881, η2 p  = 0.000).

There was a significant difference when groups and time were considered for social distance scores (df = 2, F = 4.916, p = 0.008, η2 p  = 0.035), While mean scores for control group participants remained similar, intervention group mean scores increased at each time period indicating better social distance at T3 compared to T1 (Table 3).

Recognition of depression

The intervention group was more likely to positively identify John’s condition as depression compared to the control group at all three time periods, however this difference was not statistically significant (F = 0.102, p = 0.750) (Table 4).

Table 4 Correct identification of John’s condition (recognition of depression)
Full size table

Discussion

This randomised controlled trial found face-to-face MHFA training for nursing students to be effective in changing knowledge, confidence in helping, mental health first aid intentions, social distance and overall personal stigma and personal dangerous/unpredictable stigma scores. MHFA facilitates knowledge and skills to enhance mental health literacy and enable participants to apply a mental health first aid action plan. Evaluations of MHFA have found positive changes to knowledge and awareness of mental health problems [27, 29, 49] (29) and improving confidence in help seeking and reducing stigmatising attitudes [36, 49, 50].

Similar to other studies this study found a significant increase in knowledge scores at post intervention (T2) which only slightly decreased at follow up (T3). A recent Australian study of online and face-to-face MHFA courses for university nursing and medical students found an increase in mental health knowledge, however did not use a control group [27]. A RCT measuring the impact of MHFA among teachers [29] found a significant increase in the intervention group compared to the control group, although, similar to the current study, there was some attenuation in knowledge at follow up compared to post intervention. The likelihood for attenuation in knowledge over time and the importance of the combination of knowledge, attitude and skill development to effect change [51] highlights the need for regular professional development for knowledge, attitude and skill maintenance. Although significant, knowledge scores remained relatively low, however they are comparative to those of other Australian studies [27, 29]. To date studies of MHFA have not measured retention of knowledge, recognition of depression, confidence, stigmatising attitudes or social distance over the longer term.

Recognition of depression was high at baseline for both intervention and control group participants. Although no intervention effect was found, recognition did improve among intervention group participants. At baseline (T1) and follow up (T3) 91.5% and 94.1% of intervention group students respectively correctly identified John’s condition as depression. The proportion of participants reporting correct recognition did not differ at T2 and T3 demonstrating good retention. Intervention effects may have been influenced by high baseline recognition among intervention and control group students which may be associated with participants studying nursing. Another study of nursing students found recognition of depression to be high at pre-course (face-to-face, 92.4%; online, 90.1%) and the study found no significant effects as a result of the course [27]. In comparison, baseline levels of recognition have been found to be lower among other groups completing MHFA training such as a broader university community (74% of students and 77% of staff) [6] and an Australian rural community (68% of intervention group participants and 74% of control group participants) [31]. A sample of young Australians aged 18–25 years who were not participating in a MHFA course found 58.6% were able to correctly identify depression using the vignette [52].

The MHFA training was effective in increasing the confidence of intervention group participants to help John. Confidence in supporting and help seeking is a key component of the MHFA course [36, 37, 50]. Similar to this study, other nursing and medical students have also reported increased confidence when presented with the ‘John’ vignette [27]. Teachers completing the course were also significantly more likely to report feeling confident in helping students and colleagues [29].

This study reported a significant improvement in mental health first aid intentions for intervention compared to control group participants. Similar to this study, Bond and colleagues reported nursing students’ mean mental health first aid intention scores to improve significantly for those completing online and face-to-face MHFA training [27].

Consistent with other research [26, 27] this intervention found a significant positive influence on social distance scores with respondents reporting lower levels of desire for social distance at post-test and follow up. There was also a significant positive intervention effect over time for personal stigma and ‘personal dangerous/unpredictable’ stigma. Scores for both groups demonstrated low levels of stigma at baseline which may be a characteristic of the nursing student population. Mental health professionals have been found to have lower levels of ‘personal weak-not-sick’ and ‘dangerous/unpredictable’ stigma compared to general community members [48]. Bond et al. [27] found a significant improvement in ‘personal weak-not-sick’ and ‘personal dangerous/unpredictable’ scores for both face-to-face and online nursing students at post intervention and at follow up. Another Australian study comparing data from 2003/04 to 2011 found increases in population based mental health literacy and personal contact with a person suffering depression while the desire for social distance decreased [53]. While greater awareness of depression appears to have impacted positively on social distance, beliefs that a person suffering depression was likely to be dangerous and unpredictable increased. This may be associated with awareness generated from campaigns and media stories [53]. Young people’s stigmatising attitudes have been found to influence first aid actions with those who reported higher levels of ‘dangerous/unpredictable’ stigma based on the vignette being more likely to suggest they would make a doctor’s appointment for John. In comparison, higher levels of social distance and ‘weak-not-sick’ dimensions predicted less helpful first aid responses [54]. These community-based findings highlight the importance of evidence based courses such as MHFA training to increase mental health literacy and improve help seeking actions [49].

While the Australian study discussed above demonstrated increases in mental health literacy and some levels of stigma reduced at a population level [53], a European study found despite increases in mental health literacy over an 11 year period, the desire for social distance from people with schizophrenia and depression remained unchanged [55]. It is recognised that stigma is a complex and multilayered phenomenon [54, 56] which may explain the limited change in some stigma scores in this study.

Consistent with the findings of another MHFA evaluation [27] this study found no significant intervention effect over time for the total perceived stigma of perceived ‘weak-not-sick’ or ‘dangerous/unpredictable’ factors. A RCT evaluating the impact of MHFA on teachers analysed each item for perceived stigma separately and found no significant intervention effect for any of the individual items apart from ‘other people would not tell anyone’ [29]. It is recognised that personally held stigmatising items have a distinct dimensions compared to perceived stigma [48] and the aim of MHFA is to increase health literacy and to change participant’s attitudes, as opposed to changing how participants perceive others to think [27].

A cross-sectional study of health professionals found psychologists to be less likely to hold personal stigmatising attitudes or a desire for social distance when compared to general practitioners. However, the study found although stigmatising attitudes were lower among health professionals compared to the general community, the difference between social distance scores were not significant [48].

Limitations

This study had an overrepresentation of female participants (83.6%) when compared to the overall Australian university population estimate (57%) [57]. However this overrepresentation is reflective of the nursing workforce (91.2%) [58] and is consistent with the study by Bond et al. of nursing students (91% female) [27]. While this study included a higher proportion of international students (46.4%) than the national university average (approximately 22%) [59] these findings are consistent with the enrolment profile in the School of Nursing, Midwifery and Paramedicine at this university (2015: 43% international enrolments) [60].

The study population is not representative of the general population. Nursing students are likely to have better knowledge regarding mental health problems compared to the general population. To reduce this bias first year students were selected to participate in this study. However given the study population social desirability may have threatened internal validity of the study [38]. Blinding of participants was not possible due to logistics of organising the course hence participants were aware they had been allocated to intervention or control group. This may have also impacted social desirability of responses [38]. Study contamination may have occurred as all participants were nursing students enrolled at the same university. This is recognised as a limitation of this study [41].

Drop out once allocated to a condition was higher among participants in the intervention group compared to the control group. This may have been associated with the need to complete the course during semester. Control group participants were wait listed hence could select from a range of MHFA courses after the study period.

Demographic data were not collected from randomised participants who did not complete the baseline questionnaire hence Intention to Treat analysis was conducted using the 140 baseline participants. This is a limitation of this study.

Although significant changes were found for intervention compared to control group participants for mental health literacy, confidence, mental health intentions, social distance and some stigma these changes were not large. Additional supplements to the training over a longer period of time may be necessary for greater changes.

While other studies have employed follow up of 6 months [27], follow up in this study was limited to two months after the intervention due to academic timetabling constraints limiting access to participants over a longer term. After randomisation, the intervention group recorded some dropout due to clinical rotations as some students were unable to attend both days of the MHFA course, however there was little difference in demographics among those who were lost to the study at T2 and T3. This could be overcome by embedding MHFA into a specific unit or offering the course during semester breaks.

Conclusion

MHFA can positively impact on mental health knowledge, confidence in helping, mental health first aid intentions, social distance and some aspects of personal stigma among nursing students. This course is especially relevant to nursing and other allied health students who are likely to benefit personally and professionally from the training. Providing opportunities for university students from a range of disciplines to complete MHFA courses as part of their university experience should be explored. This study did not have the capacity to measure longer term impact of the course. Following students into their second or third year of study and into the workplace to determine implementation of skills developed as part of the course should be explored. Additionally, the longer term impact of the training on participants applying skills developed should be explored. Enhanced mental health literacy, including help-seeking and lower levels of stigmatising attitudes will be beneficial to all young adults personally and in their chosen profession. University provides a structured setting to target young adults at the time when they are most likely to experience a mental health problem, or to have peers experiencing problems.

References

  1. Australian Bureau of Statistics: National Survey of Mental Health and Wellbeing: Summary of Results. In., vol. 4326.0. Canberra: Australian Bureau of Statistics; 2008.

  2. Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet. 2007;369(9569):1302–13. https://doi.org/10.1016/S0140-6736(07)60368-7

    Article  PubMed  Google Scholar 

  3. Birrel, B, Edwards, D. Half of Australian youth aged 18-20 are not in training. University World News (www.universityworldnews.com), November 2007.

  4. Leahy CM, Peterson RF, Wilson IG, Newbury JW, Tonkin AL, Turnbull D. Distress Levels and Self-Reported Treatment Rates for Medicine, Law, Psychology and Mechanical Engineering Tertiary Students: Cross-Sectional Study. Aust N Z J Psychiatry. 2010;44(7):608–15. https://doi.org/10.3109/00048671003649052

    Article  PubMed  Google Scholar 

  5. Cvetkovski S, Reavley NJ, Jorm AF. The prevalence and correlates of psychological distress in Australian tertiary students compared to their community peers. Aust N Z J Psychiatry. 2012;45(6):457–67. https://doi.org/10.1177/0004867411435290

    Article  Google Scholar 

  6. Reavley NJ, McCann TV, Jorm AF. Mental health literacy in higher education students. Early Interv Psychiatry. 2012;6(1):45–52. https://doi.org/10.1111/j.1751-7893.2011.00314.x

    Article  PubMed  Google Scholar 

  7. Stallman HM. Psychological distress in university students: A comparison with general population data. Aust Psychol. 2010;45(4):249–57. https://doi.org/10.1080/00050067.2010.482109

    Article  Google Scholar 

  8. Ibrahim K, Kelly S, Adams CE, Glazebrook C. A systematic review of studies of depression prevalence in university students. J Psychiatr Res. 2013;47:391–400. https://doi.org/10.1016/j.jpsychires.2012.11.015

    Article  PubMed  Google Scholar 

  9. Andrews B, Wilding JM. The relation of depression and anxiety to life-stress and achievement in students. Br J Psychol. 2004;95(1):509–21. https://doi.org/10.1348/0007126042369802

    Article  PubMed  Google Scholar 

  10. Blanco C, Okuda M, Wright C, Hasin DS, Grant BF, Liu SM, Olfson M. Mental Health of college students and their non-college-attending peers: results from the National Epidemiologic study on Alcohol and related conditions. Arch Gen Psychiatry. 2008;65(12):1429–37. https://doi.org/10.1001/archpsyc.65.12.1429

    Article  PubMed  PubMed Central  Google Scholar 

  11. Burns SK, Cross D, Alfonso H, Maycock BR. Predictors of bullying among 10 to 11 year old School students in Australia. Adv Sch Ment Health Promot. 2008;1:49–60. https://doi.org/10.1080/1754730X.2008.9715728

    Article  Google Scholar 

  12. Coggan C, Bennett S, Hooper R, Dickinson P. Association between bullying and mental health status in New Zealand adolescents. Int J Ment Health Promot. 2013;5(1):16–22. http://dx.doi.org/10.1080/14623730.2003.9721892.

    Article  Google Scholar 

  13. Valdez CR, Lambert SF, Lalongo NS. Identifying patterns of early risk for mental health and academic problems in adolescence: a longitudinal study of urban youth. Child Psychiatry Hum Dev. 2011;42(5):521–38. https://doi.org/10.1007/s10578-011-0230-9

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wang L. Co-occuring academic and mental health problems in high school: a longitudinal study, PhD Thesis. Chapel Hill: The University of North Carolina; 2009.

    Google Scholar 

  15. Solominski L, Sameroff A, Roseenblum K, Kasser T. Longitudinal predictors of adult socioeconomic attainment: The roles of socioeconomic status, academic competence, and mental health. Dev Psychopathol. 2011;23(1):315–24. https://doi.org/10.1017/S0954579410000829

    Article  Google Scholar 

  16. Hysenbegasi A, Hass SL, Rowland CR. The impact of depression on the academic productivity of university students. J Ment Health Policy Econ. 2005;8(3):145.

    PubMed  Google Scholar 

  17. Eisenberg D, Golberstein E, Gollust SE. Help-Seeking and Access to Mental Health Care in a University Student Population. Med Care. 2007;45(7):594–601. 510.1097/MLR.1090b1013e31803bb31804c31801

    Article  PubMed  Google Scholar 

  18. Rickwood DJ, Deane FP, Wilson CJ. When and how do young people seek professional help for mental health problems? MJA. 2007;187(7):S35–9.

    PubMed  Google Scholar 

  19. Stockings EA, Degenhardt L, Dobbins T, Lee YY, Erskine HE, Whiteford HA, Patton G. Preventing depression and anxiety in young people: a review of the joint efficacy of universal, selective and indicated prevention. Psychol Med. 2016;46:11–26. https://doi.org/10.1017/S0033291715001725

    Article  CAS  PubMed  Google Scholar 

  20. Pulido-Martos M, Augusto-Landa JM, Lopez-Zafra E. Sources of stress in nursing students: a systematic review of quantitative studies. Int Nursing Review. 2012;59(1):15–25. https://doi.org/10.1111/j.1466-7657.2011.00939.x.

    Article  Google Scholar 

  21. Reeve KL, Shumaker CJ, Yearwood EL, Crowell NA, Riley JB. Perceived stress and social support in undergraduate nursing students’ educational experiences. Nurse Educ Today. 2013;33(4):419–24. https://doi.org/10.1016/j.nedt.2012.11.009.

    Article  PubMed  Google Scholar 

  22. Reeves A. Emotional intelligence: recognizing and regulating emotions. AAOHN J. 2005;53(4):172–6.

    PubMed  Google Scholar 

  23. Smith MG. Occupational stress, job characteristics, coping, and the mental health of nurses. Br J Health Psychol. 2012;17(3):505–21. https://doi.org/10.1111/j.2044-8287.2011.02051.x

    Article  PubMed  Google Scholar 

  24. McCann TV, Lu S, Berryman C. Mental health literacy of Australian bachelor of nursing students: A longitudinal study. J Psychiatr Ment Health Nurs. 2009;16(1):61–7. https://doi.org/10.1111/j.1365-2850.2008.01330.x

    Article  CAS  PubMed  Google Scholar 

  25. Ward LJ. SMILE: Simple, mental health, initiative in learning and education. Educ Health. 2011;24(3):537.

    CAS  Google Scholar 

  26. O'Reilly CL, Bell JS, Kelly PJ, Chen TF. Impact of mental health first aid training on pharmacy students’ knowledge, attitudes and self-reported behaviour: a controlled trial. Aust N Z J Psychiatry. 2011;45(7):549–57. https://doi.org/10.3109/00048674.2011.585454

    Article  PubMed  Google Scholar 

  27. Bond KS, Jorm AF, Kitchener BA, Reavley NJ. Mental health first aid training for Australian medical and nursing students: an evaluation study. BMC Psychol. 2015;3(1):11. https://doi.org/10.1186/s40359-015-0069-0

    Article  PubMed  PubMed Central  Google Scholar 

  28. Crawford G, Burns S, Chih J, Hunt K, Tilley M, Hallett J, Coleman K, Smith S: Mental Health First Aid training for nursing students: a protocol for a pragmatic randomised controlled trial 2015, 5 (26). DOI 10.1186/s12888–015–0403-3.

  29. Jorm AF, Kitchener BA, Sawyer MG, Scales H, Cvetkovski S. Mental health first aid training for high school teachers: a cluster randomized trial. BMC Psychiatry. 2010;10(51) https://doi.org/10.1186/1471-244x-10-51

  30. Hossain D, Gorman D, Eley R, Coutts J. Value of mental health first aid training of advisory and extension agents in supporting farmers in rural Queensland Rural and Remote Health. 2010;10:1593 (online)

  31. Jorm AF, Kitchener BA, O'Kearney R, Dear K. Mental health first aid training of the public in a rural area: a cluster randomized trial. BMC Psychiatry. 2004;4(33) https://doi.org/10.1186/1471-244x-4-33

  32. Burns S, Crawford G, Hallett J, Jancey J, Portsmouth L, Hunt K, Longo J. Consequences of low risk and hazardous alcohol consumption among university students in Australia and implications for health promotion interventions. Open Journal of Preventive Medicine. 2015;5:1–13. https://doi.org/10.4236/ojpm.2015.51001

    Article  CAS  Google Scholar 

  33. Burns S, Hart E, Jancey J, Hallett J, Crawford G, Portsmouth L. A cross sectional evaluation of a total smoking ban at a large Australian university. BMC Research Notes. 2016;9:288. https://doi.org/10.1186/s13104-016-2090-7

    Article  PubMed  PubMed Central  Google Scholar 

  34. Kenneth FS, Douglas GA, David M. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. https://doi.org/10.1136/bmj.c332

    Article  Google Scholar 

  35. Kitchener B, Jorm A, Kelly C. Mental Health First Aid Manual. 3rd ed. Melbourne: Mental Health First Aid Australia; 2013.

    Google Scholar 

  36. Kitchener BA, Jorm AF. Mental health first aid training in a workplace setting: A randomized controlled trial. BMC Psychiatry. 2004;4:23. https://doi.org/10.1186/1471-244X-4-23

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kitchener BA, Jorm AF. Mental health first aid training: review of evaluation studies. Aust N Z J Psychiatry. 2006;40(1):6–8. https://doi.org/10.1080/j.1440-1614.2006.01735.x

    Article  PubMed  Google Scholar 

  38. Portney LG, Watkins MP. Foundations of Clinical Research: Applications to Practice. Connecticut: Appleton & Lange; 1993.

    Google Scholar 

  39. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association; 2000.

    Google Scholar 

  40. World Health Organization. The ICD-10 classification of mental and behavioural disorders: Clinical descriptions and diagnostic guidelines. Geneva: World Health Organisation; 1992.

    Google Scholar 

  41. Yap MB, Jorm AF. Young people's mental health first aid intentions and beliefs prospectively predict their actions: findings from an Australian National Survey of Youth. Psychiatry Res. 2012;196(2–3):315–9. https://doi.org/10.1016/j.psychres.2011.10.004

    Article  PubMed  Google Scholar 

  42. Yap MB, Wright A, Jorm AF. First aid actions taken by young people for mental health problems in a close friend or family member: findings from an Australian national survey of youth. Psychiatry Res. 2011;188(1):123–8. doi:10.1016/j.psychres.2011.01.014.

  43. Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C. Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatising attitudes to depression: A randomised controlled trial. Br J Psychiatry. 2004;185:342–9. https://doi.org/10.1192/bjp.185.4.342.

    Article  PubMed  Google Scholar 

  44. Link BG, Phelan JC, Bresnahan M, Stueve A, Pescosolido BA. Public conceptions of mental illness: labels, causes, dangerousness, and social distance. Am J Public Health. 1999;89:1328–33. https://doi.org/10.2105/AJPH.89.9.1328

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Yap MB, Mackinnon A, Reavley N, Jorm AF. The measurement properties of stigmatizing attitudes towards mental disorders: Results from two community surveys. Int J Methods Psychiatr Res. 2014;23(1):49–61. https://doi.org/10.1002/mpr.1433.

    Article  PubMed  Google Scholar 

  46. Jorm AF, Wright A. Influences on young people's stigmatising attitudes towards peers with mental disorders: national survey of young Australians and their parents. Br J Psychiatry. 2008;192(2):144–9. https://doi.org/10.1192/bjp.bp.107.039404

    Article  PubMed  Google Scholar 

  47. Corrigan PW, Shapiro JR. Measuring the impact of programs that challenge the public stigma of mental illness. Clin Psychol Rev. 2010;30(8):907–22. https://doi.org/10.1016/j.cpr.2010.06.004

    Article  PubMed  PubMed Central  Google Scholar 

  48. Reavley NJ, Mackinnon AJ, Morgan AJ, Jorm AF. Stigmatising attitudes towards people with mental disorders: A comparison of Australian health professionals with the general community. Australian & New Zealand Journal of Psychiatry. 2014;48(5):433–41. https://doi.org/10.1177/0004867413500351

    Article  Google Scholar 

  49. Hadlaczky G, Hokby S, Mkrtchian A, Carli V, Wasserman D. Mental Health First Aid is an effective public health intervention for improving knowledge, attitudes, and behaviour: a meta-analysis. Int Rev Psychiatry. 2014;26(4):467–75. https://doi.org/10.3109/09540261.2014.924910

    Article  PubMed  Google Scholar 

  50. Kitchner B, Jorm AF. Early Intervention in the Real World Mental Health First Aid: an international programme for early intervention. Early Intervention in Psychiatry. 2008;2008(2):55–61. https://doi.org/10.1111/j.1751-7893.2007.00056.x

    Article  Google Scholar 

  51. Egger G, Spark R, Donovan R. Health promotion strategies and methods. North Ryde: McGraw Hill Education; 2013.

    Google Scholar 

  52. Wright A, Harris MG, Wiggers JH, Jorm AF, Cotton SM, Harrigan SM, Hurworth RE, McGorry PD. Recognition of depression and psychosis by young Australians and their beliefs about treatment. Med J Aust. 2005;183(1):18–23.

    PubMed  Google Scholar 

  53. Reavley NJ, Jorm AF. Stigmatising attitudes towards people with mental disorders: changes in Australia over 8 years. Psychiatry Res. 2012;197(3):302–6. https://doi.org/10.1016/j.psychres.2012.01.011

    Article  PubMed  Google Scholar 

  54. Yap MB, Jorm AF. The influence of stigma on first aid actions taken by young people for mental health problems in a close friend or family member: findings from an Australian national survey of youth. J Affect Disord. 2011;134(1–3):473–7. https://doi.org/10.1016/j.jad.2011.05.039

    Article  PubMed  Google Scholar 

  55. Angermeyer MC, Holzinger A, Matschinger H. Mental health literacy and attitude towards people with mental illness: a trend analysis based on population surveys in the eastern part of Germany. Eur Psychiatry. 2009;24(4):225–32. https://doi.org/10.1016/j.eurpsy.2008.06.010

    Article  CAS  PubMed  Google Scholar 

  56. Yap MB, Reavley N, Mackinnon AJ, Jorm AF. Psychiatric labels and other influences on young people's stigmatizing attitudes: Findings from an Australian national survey. J Affect Disord. 2013;148(2–3):299–309. https://doi.org/10.1016/j.jad.2012.12.015

    Article  PubMed  Google Scholar 

  57. Australian Bureau of Statistics. Australian Social Trends: Education Differences Between Men and Women. Canberra: Australian Bureau of Statistics; 2012.

    Google Scholar 

  58. Health Workforce Australia (HWA). Australia’s Health Workforce Series – Nurses in focus. Adelaide: HWA; 2013.

    Google Scholar 

  59. Australian Bureau of Statistics: , Australian Social Trends, December 2011 International Students. In. Canberra: Australian Bureau of Statistics; 2012.

  60. Office of Strategy and Planning CU. School of Nursing, Midwifery and Paramedicine Student Headcount. Perth: Curtin University; 2016.

    Google Scholar 

Download references

Acknowledgements

We would like to thank the School of Public Health and the School of Nursing and Midwifery for their support.

Funding

This project was funded in part through a Seed Funding Research Grant from the School of Public Health, Curtin University.

Availability of data and material

The data sets during and/or analysed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

SB was responsible for coordinating the contribution of all authors to this paper. GC conceived the idea for the study. GC and KH coordinated the study and the data collection. SB, JC and KH conducted the data analysis for this paper. SB and KH drafted the manuscript. GC, JH, JC and MT contributed to writing and revising the manuscript. All authors read, edited and provided critical feedback on the final manuscript and approved it for publication.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study was approved by Curtin University Humans Research Ethics Committee (SPH-74-2013). Participants provided consent when they completed the baseline survey.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. Collaboration for Evidence, Research and Impact in Public Health, School of Public Health, Faculty of Health Sciences, Curtin University, GPO Box U1987, Perth, WA, 6845, Australia

    Sharyn Burns, Gemma Crawford, Jonathan Hallett, Kristen Hunt & P.J. Matt Tilley

  2. School of Public Health, Faculty of Health Sciences, Curtin University, Perth, Australia

    Hui Jun Chih

Authors
  1. Sharyn Burns
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gemma Crawford
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jonathan Hallett
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kristen Hunt
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hui Jun Chih
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. P.J. Matt Tilley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sharyn Burns.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Burns, S., Crawford, G., Hallett, J. et al. What’s wrong with John? a randomised controlled trial of Mental Health First Aid (MHFA) training with nursing students. BMC Psychiatry 17, 111 (2017). https://doi.org/10.1186/s12888-017-1278-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-017-1278-2

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us