Skip to main content

Artificial neural network application for identifying risk of depression in high school students: a cross-sectional study

Abstract

Background

Identifying important factors contributing to depression is necessary for interrupting risk pathways to minimize adolescent depression. The study aimed to assess the prevalence of depression in high school students and develop a model for identifying risk of depression among adolescents.

Methods

Cross-sectional study was conducted. A total of 1190 adolescents from two high schools in eastern China participated in the study. Artificial neurol network (ANN) was used to establish the identification model.

Results

The prevalence of depression was 29.9% among the students. The model showed the top five protective and risk factors including perceived stress, life events, optimism, self-compassion and resilience. ANN model accuracy was 81.06%, with sensitivity 65.3%, specificity 88.4%, and area under the receiver operating characteristic (ROC) curves 0.846 in testing dataset.

Conclusion

The ANN showed the good performance in identifying risk of depression. Promoting the protective factors and reducing the level of risk factors facilitate preventing and relieving depression.

Peer Review reports

Background

Depression is a common syndrome in adolescents, which is decreasing quality of life and potentially leading to significant morbidity and suicidality [1]. Depression is also a leading cause of disability of adolescents worldwide [2] and accounts for global burden of disease [3]. Lifetime prevalence of depression was reported as 20% in teenagers at late adolescence [4]. The prevalence of depression is still increasing, especially among adolescents [5]. Depression in adolescence was also associated with adulthood psychosocial impairments and mental health disorders [6, 7]. Besides impairing the flourish of adolescents, suicide, the third leading cause of older adolescents’ death is the most devastating concern for adolescent depression [8]. Despite the multiple inventions and treatment, about 1/3 patients failed to achieve remission from treatment attempts [9]. Therefore, preventive measures are becoming increasing important. It is essential to timely recognize the key factors contributing to the prevalence of depression.

Many factors have been discovered to be associated with depression. Risk factors such as life events [10], and perceived stress [11] were associated with depression. Protective factors such as resilience [12], mindfulness [13], self-efficacy [14] and social support [15, 16] were inversely associated with depression.

Although studies have tended to focus on correlation of some risk factors and protective factors with depression separately, the key important factors in analyzing these factors at the same time remain poorly understood. Little is known about which factors in combination of environmental factors and individual factors mostly influencing depression. A targeted prevention strategy is suggested for its effective efforts in preventing the development of depression in adolescents at risk [7]. Prevention measures could target at reducing the modifiable risk factors and improving levels of protective factors for adolescents at high-risk. Preventions targeting at high-risk groups are promising. But the key components for these strategies and programs remain unclear and need to pay priority attention in future depression research [7]. Therefore, identifying the key factors from a variety of factors and the students at risk of depression are essential for prevention and treatment of depression.

In addition, self-compassion was inversely associated with psychological distress [17]. Other factors like exercise, nutrition diet, anxious responses when facing examinations, having a clear goal, and optimism were unsure whether to be the significant factors contributing to depression among adolescents. Exercise is beneficial for mental health and may protect against depression [18]. However, no clear evidence indicated that all levels of exercise contributing to increasing positive mental health and decreasing negative health. The present study will examine whether exercise is an important factor related to depression. Examinations are of major importance for high school students and may cause anxious responses if they cannot handle. In China, parents have high expectations for children’s academic performance. Thus, this social pressure may stimulate their anxiety for exams. Optimism involves positive expectations and attitude that outcomes will be in the right direction and desirable [19]. Optimism has been associated with coping skills [19]. Depression onset was predicted by hopelessness in adolescents [20]. Therefore, low level of optimism is potentially related to depression among adolescents. Having a clear goal for future means students may focus on their study goal with energy and have less time indulge in emotional worries. This distraction may be a protective factor for depression [21]. Considerable interest has been gained in the association between nutrition and mental health. Poor nutrition may be associated with low mood [22].

How these protective factors and risk factors mentioned above functions together on depression onset is not clear. Identifying important factors contributing to depression is necessary for interrupting risk pathways to minimize adolescent depression. Identifying the important factors from potential related factors may offer more precise components to target and modify in interventions.

An increasing interest has been in the trend in developing models for identifying the risks of depression. In this study, artificial neural network was used to identify depression and which factors are among the highest contributing features. Artificial neural networks (ANN) are computer models that imitated human brain, which can process multidimensionality of complex data and detect all possible interactions in building predictive or identification model.

The study aimed to identify the key factors from demographics, individual factors and environmental factors that may contribute to the depression of students and detect the pattern of depressive students.

Methods

Study design

A cross-sectional design was employed and machine learning method was used to examine the factors associated with depression among high school students.

Protective and risk factors (Input variables) include 1) Demographics (age, gender and study year); 2) Individual factors (Exercise; hobby; diet nutrition, personality; psychological factors including anxious responses when facing exams, having a clear goal, self-efficacy, resilience, self-compassion, perceived stress, optimism, and mindfulness). 3) Environmental factors (Life events, social support). Figure 1.

Fig. 1
figure 1

Hypothesized potential protective factors and risk factors of depression in the study

Participants

Participants were high school students from two middle schools in Qingdao, Shandong Province. Inclusion criteria were that participants were high school students and willing to participate after instruction. The entrance age for the first year of high school in China was usually 15 years old. Exclusion criteria of recruitment were that students who were not high school students or younger than 14 years. The researcher first explained the study aim and methods to the teachers of the high schools. Students were recruited using convenient sampling via teachers or head of teachers in the two high schools. The students were given the internet link and scanning code generated by online tool (questionnaire star, Changsha Ranxing information technology Co, Ltd., China) to read the instruction of the study aim and procedure in detail again before deciding participation or not.

Ethical considerations

The study conformed to declaration of Helsinki and obtained the approval from the Ethical review of a University in China (2019–17/2020–21). The potential participants read the aims and instructions of filling questionnaires, and informed their parents. If they agreed to participate after reading the instruction, they could discuss with their parents at home during holiday and made the final decision to completed the questionnaires or not. They can click quitting the questionnaire link at any time and if they agree they continue to fill the questionnaires. The participation was totally voluntary. They can withdraw at any time. The instruments in the study were approved by original authors when necessary.

Measures for input and output variables

Demographics and single-item measures

Demographics included age, gender and grade (study year). Exercise such as jogging and playing balls daily was measured by a question responded as follows: over an hour (scored 1), 0.5-1 h (scored 2) and below 0.5 h (scored 3). Hobby was measured by a question “Whether you had a wide range of hobbies”, with responded as follows: Not wide at all (scored 1), not wide (scored 2), not sure (scored 3), wide (scored 4), very wide (scored 5). Diet nutrition was measured by a question with responded choices as follows: food types were various, nutrition was balanced (Scored 1); food types and nutrition were in general level (Scored 2); food types are limited and nutrition was not balanced (Scored 3). Anxious responses when facing exams were measured by a question responded as follows: very anxious (scored 1), anxious (scored 2), not sure (scored 3), a bit anxious (scored 4), no anxious at all (scored 5). Having a clear goal for future was measured by an item responded as follows: None (scored 1), largely not (scored 2), sometimes (scored 3), yes (scored 4).

Multidimensional scale of perceived social support (MSPSS)

Social support was measured by MSPSS [23]). The scale has three dimensions named family, friends and significant other. The MSPSS has 12 items with 7 possible responses to each statement, scored from 0 to 6. The higher score indicates a higher level of MSPSS. Cronbach’s a was 0.88 [24].

Adolescent self-rating negative life events checklist

Life events were measured by Adolescent self-rating life events checklist, including if the negative life events happen and their negative influence over the past 12 months [25]. The scale has 26 coding items with two kinds of response options [26]. Each item represents a negative life event such as misunderstanding by others, failed in examination, conflict with classmates, tense relationships with teachers, accident, disease, family economic difficulties. If the life events did not happen, the answer was scored 0. If happened, the negative influence (scored from 1 indicating no influence at all to 5 indicating extremely serious) will be chosen. The Cronbach’s alpha was 0.92, and it had good validity [26]. Higher scores indicate more serious negative influence.

Perceived stress scale (PSS)

Perceived stress was measured by Perceived Stress Scale [27]. The PSS consists of 10 items measuring the experience of stressful situations in the past month. The scale has response options from never (0) to very often (4). Four items are reversing responses. A higher score means higher level of perceived stress. Cronbach’s α of the scale is good and was 0.86 [28].

10-item Connor-Davidson resilience scale

Resilience was measured using the 10-item Connor-Davidson Resilience Scale [29], which is modified from original scale [30]. The scale has a dimension with 5-likert responses from never (0) to almost always (4). The Cronbach’s a was 0.85 [29]. The higher score means a higher level of resilience.

Generalized self-efficacy scale

Self-efficacy was measured by Generalized Self-Efficacy Scale, which consists 10 items [31]. Cronbach’s alphas ranged from 0.79 to 0.90 [32]. The four-point responses are from not at all true (1) to exactly true (4). A higher score indicates higher self-efficacy.

Neff’s self-compassion scale (short-form)

Self-compassion was measured by Neff’s Self-Compassion Scale (Short-form) [33]. The short version scale consists of 12 items and 6 dimensions as follows: self-kindness, common humanity, mindfulness, self-judgment, isolation, over-identified. The response options were from almost never (1) to almost always (5) [34]. Cronbach’s alpha was over 0.82 [34, 35]. The total score was summing the positive items and negative items after reversing. The higher score indicates high level of self-compassion. Although self-compassion scale has the mindfulness component, it is “…narrower in scope than mindfulness more generally” [36] (p20). The general and broader concept of mindfulness includes all awareness of all aspects of experience. Therefore, using independent measures to test self-compassion and mindfulness was suggested [17].

Five facet mindfulness questionnaire (FFMQ)

Mindfulness was measured by Five Facet Mindfulness Questionnaire (FFMQ) [37]. The scale consists of 39 items and five dimensions including observing, describing, acting with awareness, nonjudging of inner experience, and nonreactivity to inner experience. The response options were ranged from never or very rarely true (1) to very often or always true (5). Cronbach’s a of five facets ranged from 0.75 to 0.91 [37]. FFMQ total scores are obtained by summing reversing responses and positively stated items. A higher score indicates higher level of mindfulness.

10- item personality measure

Personality was measured by 10-item Personality Measure. The scale is a measure of the Big Five (or Five-Factor Model) dimensions including extraversion, agreeableness, conscientiousness, emotional stability and openness to experiences [38]. Response options ranged from disagree strongly (1) to agree strongly (7). A higher score indicates higher level of extraversion, agreeableness, conscientiousness, emotional stability or openness to experience. Total scores are obtained by summing reversing responses and positively stated items. Test–retest reliability averaged 0.72 for the 5 dimensions [38].

Life orientation test (LOT)

Optimism was measured by Life Orientation Test (LOT) [19]. The LOT-R is shortened from LOT [39] which has 10 items. Fillers includes items 2, 5, 6, and 8. The response options ranged from strongly disagree (0) to strongly agree (4). The Cronbach’s a was 0.74 [40]. Total score was summing by positive and negative items after reversing. High values imply high level of optimism.

Patient health questionnaire (PHQ)

Target variable depression was measured by PHQ-9, the patient health questionnaire. The PHQ-9 consists of nine symptom items of depressive in the past 2 weeks. Response options ranged from “not at all (scored 0),” to “nearly every day (scored 3)”. The sum scores ranged from 0 to 27. The scores indicating severity of depressive symptoms was categorized as follows: 0, none; 1–4, minimal; 5–9, mild; 5–9; moderate, 10–14; moderately severe, 15–19; or 20–27, severe. PHQ-9 ≥ 10 was found to have a sensitivity of 88% and a specificity of 88% to detect major depression, with MHP (mental health professional) reinterview as criteria [41]. Thus, PHQ-9 scores of ≥10was classified as major depression in this study. The PHQ-9 has Cronbach’s α > 0.8 and has been validated in different groups [41, 42].

Data collection

Data were collected by online tool, questionnaire star during the holiday of National Day from 2020 October 1st to 2020 October 9th. The survey was gained the teachers’ informed consent and questionnaires with instruction of the study aim and procedure were distributed by teachers and the participation was informed totally voluntary at school. The online questionnaires were distributed on national holiday when students were at home for holiday. Thus, students had sufficient time to discuss with their parents. With parental consent, they freely chose to fill the questionnaires or not.

Data analysis

IBM SPSS Modeler Version 18.2.2 and IBM SPSS 25.0 were used to analyze the data. The data were cleaned by imputing the missing values in age, replacing the outliers with the ones closed to normal ones and discarding the extremes. Outliers exceed the range of Q1–1.5 × IQR (Interquartile range) and Q3 + 1.5 × IQR. Extremes exceed the range of Q1–3 × IQR and Q3 + 3 × IQR. Outliers were replaced by the normal values closest to them: Q1–1.5 × IQR (Interquartile range) or Q3 + 1.5 × IQR. The action of coercing outliers/discarding extremes was conducted in the SPSS modeler. Median was used as imputation method of missing value, which replaces missing data with median of non-missing elements in the corresponding variable. Fifty-one missing values in age were imputed by the median of the ages in same grade in the study. The cleaned data were standardized by subtracting the mean score and divided by standard deviation, so that all the continuous inputs are at a comparable range. The averaged overall accuracy and AUC (area under the ROC curve) of ANN model, decision tree, Bayesian networks and logistic regression were chosen to select the better one for identifying the risk of depression in SPSS modeler setting with five-fold cross validation. The dataset was then divided into two datasets in division node: Training set (70%) and Testing set (30%). The model built and patterns extraction is conducted in training dataset and evaluated in the testing dataset.

ANN has the capability to process the nonlinear relationships between input and output via a training dataset, when traditional approaches are insufficient to calculate the complex input-output relationship [43]. After the training process by ANN, the ANN was validated with the testing dataset and the performance ranked with the other machine learning methods including decision tree, logistic regression, and Bayesian network according to overall accuracy and area under the ROC curve (AUC). Decision trees is a classification technique that can identify efficiently the most important contributing factors. It develops a predictive algorithm to identify the factors differentiating the sample population on a target variable, until it reaches one of the terminal nodes, the percentage of each class in the terminal node was provided [44]. The decision tree algorithms include C5.0, C&R Tree (Classification and Regression tree), CHAID (Chi-Square Automatic Interaction Detection) and Quest. Bayesian networks can model variables simultaneously in an exploratory manner. Logistic regression models the linear relationships of a set of independent variables and dependent variables and the occurring probability of the dependent variable is determined by the estimated probability.

Model performance were evaluated by accuracy (The percentage of correct identifications in total identifications.), sensitivity, specificity and receiver operating characteristic (ROC), area under the ROC curve (AUC). The sensitivity is true positive rate and reflects the percentage of depressive students that are correctly identified in the model. Specificity is the true negative rate and reflects the percentage of students who are not depressed that are correctly identified in the model. ROC analysis estimates a curve that describes the inherent trade-off between sensitivity and specificity for prediction or identification tool. AUC is an important metric to evaluate prediction or identification tools ranged from 0 to 1, with 1.0 reflecting perfect discrimination and 0.5 reflecting that the discrimination is by chance alone [45]. To test the generalization ability of the ANN model, ten-fold cross validation was used.

The procedure and method of data collection and analysis were shown in Fig. 2.

Fig. 2
figure 2

The flowchart of the study

Results

A total of 1190 students participated in the e-survey. The completion time of the questionnaires in the back-stage management system of the online survey tool (questionnaire star) were checked by the researcher. Among them, 115 quick click ones were excluded based on the much shorter completion time compared to others during the survey. Thus, 1075 questionnaires were retained for analysis. The fifty-one missing values in the age variable were imputed by age median of the same grade. There were outliers and/or extremes in variables including perceived stress, social support, personality, life events, resilience, self-compassion, optimism and mindfulness. Among them, entire observations with extremes were deleted. After coercing outliers and discarding extremes conducted in the SPSS modeler, 1029 students’ questionnaires were included in the study.

Demographics and compassion between groups

The girls accounted for 59.2% and boys amounted for 40.8%. The prevalence of depression was 29.9% among the students in the study. For girls, the prevalence of depression was 28.4% and for boys was 32.1% in the study. The detailed descriptive information for study variables, statistical test results for the factors between two groups with depression or not were shown in Table 1.

Table 1 Input variables and the difference between no depression group and depression group

Model selection and artificial neural network (ANN) analysis

The auto classifier estimated and ranked algorithms. The averaged overall accuracy, with AUC which was an index of performance of models. Accuracy and AUC of ANN (78.81%, 0.834), logistic regression (77.84%, 0.843), CHAID (76.95%, 0.803), C5.0 (76.38%, 0.755) Quest (75.82%, 0.663), C&T (75.66%, 0.767), and Bayesian networks (72.65%, 0.773) were ranked with five-fold cross-validation. The performance of ANN is better to identify depression. ANN model was selected for identifying risk of depression in the study.

Then, the 70% of the dataset was used as training set and 30% of the dataset was used as testing set. Artificial Neural network was conducted with inputs, hidden neurons and outputs. The structure of the selected ANN has one input layer, one hidden layer and one output layer. These inputs include demographics (age, gender, grade), and individual factors (hobby, exercise, diet nutrition, personality), psychological factors (anxious responses in facing exam, have a clear goal for future, self-efficacy, resilience, self-compassion, perceived stress, optimism, and mindfulness), and environmental factors (life events, social support). Each neuron processes the inputs using a non-linear transfer function (Customer size of unit hidden layers was set 8). A multi-layer perception (MLP) was used to train the model. The identification of the risks of depression was thought to be a form of pattern recognition and the ANN was trained using patterned function which classifies inputs into a target.

Evaluation of the ANN model

In the training set (n = 728), overall accuracy of the ANN was 81.59%, sensitivity was 57.3%, specialty was 91.7%, AUC was 0.871.

After the training process, the network was tested with the remaining students (n = 301) that were not randomly chosen for training. Based on the results in the testing set, ANN had a higher proportion of correctly identified students who have depression (Sensitivity) than CHAID, Quest, C5.0, C&T Tree, Logistic regression and Bayesian Network, and ANN model had lower proportion of correctly identified students who have no depression (Specificity) compared to Quest in this study. However, ANN model had better accuracy and discriminating power with an AUC of 0.846 among all the tested models. Table 2.

Table 2 Comparison of predictive performance of ANN, CHAID, Quest, C5.0, C&T Tree, Logistic regression, and Bayesian Network of testing set (N = 301)

Factor importance in ANN model

Figure 3 showed that the ANN model recognized 10 important factors for the network to identify the depression of the students. The 10 important with the normalized coefficients were as follows in order: perceived stress (importance = 0.261), life events (importance = 0.114), optimism (importance = 0.087), self-compassion (importance = 0.077), resilience (importance = 0.051), having clear goal for future (importance = 0.049), social support (importance = 0.045), hobby (importance = 0.040), anxious responses when facing exams (importance =  0.039), diet nutrition (importance = 0.038). Figure 3 shows the importance of each factor in the algorithms. Figure 4 showed the ANN model with the effects of top 10 important factors on identifying depression through the eight neurons’ processing by a non-linear transfer function in hidden layer.

Fig. 3
figure 3

Importance of protective and risk factors (Training set N = 728)

Fig. 4
figure 4

The effects of the factors in artificial neural network

Overall accuracy and coincidence matrix of ANN model

Overall accuracy of the ANN was 81.59% in training set and 81.06% in testing set. AUC was 0.871 in training set and 0.846 in testing set.

The coincidence matrix in training set and testing set was shown in Table 3. It indicates actual and the identified value of the model for depression. True positive (TP) indicates the model identifying the actual depression. True negative (TN) indicates the model identifying actual state of not depression. False positive (FP) and false negative (FN) indicates the model identifying incorrectly.

Table 3 Coincidence matrix of ANN

Sensitivity, specificity and receiver operating characteristics (ROC) in training set and testing set of ANN model

The sensitivity was 57.3% in training set and 65.3% in testing set. The specificity was 91.7% in training set and 88.4% in testing set. Although the sensitivity was not high, considering the percentage of depression was 29.9%, the sensitivity was acceptable.

ROC chart is shown in Fig. 5A,B. The vertical axis represents sensitivity and horizontal axes represents 1-specificity. The area under the curve (AUC) was 0.871 in training dataset and 0.846 in testing dataset.

Fig. 5
figure 5

A, B. Chart of area under the receiver operating characteristic (ROC) curves ROC curves for the ANN model. Training set (N = 728). b testing set (N = 301)

Ten-fold cross validation

The averaged overall accuracy was 77.90% and AUC was 0.830 in the ten-fold cross validation of ANN model. The results were close to those that had the partition of 70% training set and 30% testing set in accuracy and AUC, which showed that ANN model identification was stable and had generalization ability.

Discussion

In the 17 factors included in analysis, the top 10 ones were perceived stress, life events, optimism, self-compassion and resilience, having clear goal for future, social support, hobby, anxious response when facing exams, and diet nutrition. The ANN model showed better performance in depression identification, which had 0.871 AUC in the training dataset and 0.846 AUC in testing dataset.

Perceived stress is the most highly influencing factor of depression among high school students in the present study. Perceived stress is a distinct construct from depression and anxiety [27], and different from life events. Life events are the stressors, and the present study also confirmed the relationships between negative life events and depression in consistent with previous study [10]. Adolescents are more vulnerable to the influence of stressors and stress perception because of their developing brains [46]. But there are other positive psychological resources exerting important influence on mental health in this present study and can buffer the negative effect of stressors.

Optimism is an important protective factor of depression among adolescents in the present study. Students with low level of optimism were more likely to have depression. Optimism has been indicated to be associated with individuals’ physical and mental health [47]. In the present study, optimism is essential in decreasing or preventing depression among adolescents. This result may be explained that optimistic individuals are more likely to adapt coping strategies in face of problems [48], more likely to adjusting negative emotion. Developing the students’ positive attitude and perspectives toward negative situation is beneficial in preventing depression.

Self-compassion, includes self-kindness, common humanity, and mindfulness, is the ability to be gentleness with oneself when facing challenge or failure. Self-kindness during difficult times is different from self-indulgence or decreasing standards [49]. Self-compassion was important in decreasing the risk of depression in high school students in this study. Individuals with higher level of self-compassion tend to display self-kindness to relive their suffering and make healthy changes to improve themselves [50]. In addition, self-compassion enables individuals to accept themselves unconditionally and treat themselves kindly which can reduce the negative impact by stress [35].

Resilience refers to the individuals’ ability to navigate towards health-maintaining resources in the face of adversity, and the capacity to bounce back from adverse events [51]. The present study indicated its importance role in defensing the risk of depression, and support the finding that resilient persons could better cope with adversity and exhibited fewer mental problems [52]. Although mindfulness variable did not appear in top 10 importance factors in identifying depression, mindfulness techniques were suggested to be an effective way to train resilience [53], which in turn, negatively associated with depression.

Having a clear goal may be beneficial for focusing attention on the pursuit of life goal and less time to indulging in negative emotion. It is suggested that interventions that specifically address goal pursuit are more likely to decrease depressive symptoms in clinical and non-clinical populations [54]. Having a clear goal is the first step before goal pursuit. Teachers and parents may be good supporters to help adolescents to set a clear future goal to pursuit.

The present study also showed social support was important in defensing depression. The support sources varied across life periods. Family members are the most important support among children and adolescents, while spouses are the main support among adults and elder adults, followed by family and then friends [15]. Social support is an environmental protective factor and should not be overlooked when promote mental health.

Although hobbies have been less studied [55], hobbies are described as cultivating youths’ unique areas of strength to promote positive development [56]. The present study indicated that hobby is one of the top 10 important factors in preventing depression. Hobby has the potential to enhance youth’s skills, emotion regulation and connection with peers [55].

Students may have negative emotional reactions that is understood as anxiety in face of an exam. The anxious reaction can produce physiological and behavioral changes before the exam and damage the performance during exam [57]. Some students are more likely to generate anxious reaction in exam [58]. Some students may be worried failing the exam which impacts goal achievement or let families and important others down. It is suggested to provide test preparation tips for students to reduce text anxiety. A well-prepared student is less anxious when he or she perceives that the exam is not difficult and ready for the exam [59]. Encouraging inner growth of students and making progress step by step is advised.

Adolescents is at the stage of growing quickly. Various kinds of foods not only satisfy their body needs, but may also meet their mental needs. Nutrition entered the tenth important factors. Diet rich in vegetables, fruits, berries, whole grains and fish was possibly associated with decreased risk of depression [60]. Diet with a high glycemic load increases risk of depression in participants [61]. Therefore, diet nutrition should involve various and moderate nutrient in foods. Poor nutrition may lead to low mood, and improving diet may help to protect not only the physical health but also the mental health [22].

The other study variables such as age, gender, grade, exercise, personality, self-efficacy and mindfulness did not enter the top 10 important factors. Whether their effects differ in different groups is needed to be further tested and confirmed.

The ANN also can be trained in different models that fit the characteristics of their own students. The identification risk of depression by ANN models possibly be more precise than a score model. Identifying students at high risk of depression before preventive interventions becomes very important. A good prediction or identification model for depression needs high sensitivity, specificity, and AUC. The ANN had better accuracy, sensitivity, AUC compared to other models evaluated in this study. For the study was not externally validated, whether the ANN model developed in two high schools in Eastern China performed as well in other schools was unsure. However, the ANN also can be trained in any institution for fitting the characteristics of the groups [62]. Evaluation of the use of identification models in improving the effects of preventive intervention of depression will be needed. The sensitivity is not high in the study. To improve the sensitivity, more features of variables should be included in future study. For example sleep duration, communication problems with teaching staff were recently found to be predictors of depression among health professions students [63]. In future studies, adding potential risk factors may increase sensitivity of the model. In addition, development of an instrument focused on measuring risk factors of depression may targeted depression more correctly and increase the sensitivity.

Limitations

There were several limitations in the study. First, the study used a cross-sectional design; so, the depression had been onset in the study time not in the follow-up time. Therefore, the longitudinal association between factors and depression is needed to claim the predictive effects of ANN model in future exploration. Second, this study measured some individual factors using a single item. They may have greater survey effectiveness due to less time-consuming for participants [64]. However, single-item scales contain limited information. A standardized tool such as the dietary diversity questionnaire could have been a better option to provide more information. Third, self-report bias may exist in using the self-report measures. For personality and social psychological factors are comparatively stable variables without intervention, their valid information can be obtained from self-report measures. Finally, the study mostly focused on individual factors and social psychological factors of depression among high school students, while other important factors may exist in different groups like students with specific disease.

Implications for practice

The findings have the following implications for further research and practice. This study employed ANN to identify risk of depression, providing the understanding of the non-linier effects of multiple factors. It implied that ANN can correctly identify students who are depressed and not depressed. Therefore, ANN is recommended in the study to identify the risk of depression of the students.

Mental health staff can target key components identified in the model in intervention program and further test and compare the effects with routine care. Improving the level of protective factors like self-compassion, optimism and resilience of students in clinical practice and school community are beneficial to decrease or prevent depression.

Conclusions

Depression may contribute to students’ drop out, self-injury, and even suicide. To prevent this, the artificial neural network was used in the study to identify the key factors of depression and identify the students at high risk of depression. This study described the prevalence of depression among high school students and analyze the important factors contributing to depression in psychiatric nursing and offers the evaluation for the performance of the identification model. This enables a specific view on identification of risks and prevention of depression in adolescents.

Availability of data and materials

The datasets used and analyzed during this study are available from the corresponding author on reasonable request.

Abbreviations

ANN:

Artificial neural network

FN:

False negative

FP:

False positive

TN:

True negative

TP:

True positive

CHAID:

Chi-Square Automatic Interaction Detection

C&R Tree:

Classification and Regression Tree

ROC:

Receiver Operating Characteristic

AUC:

Area under ROC curve

References

  1. DeFilippis M, Wagner KD. Management of treatment-resistant depression in children and adolescents. Paediatr Drugs. 2014;16(5):353–61. https://doi.org/10.1007/s40272-014-0088-y.

    Article  PubMed  Google Scholar 

  2. James SL, Abate D, Abate KH, Abay SM, Abbafati C, Abbasi N, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the global burden of disease study 2017. Lancet. 2018;392(10159):1789–858. https://doi.org/10.1016/S0140-6736(18)32279-7.

    Article  Google Scholar 

  3. Malhi GS, Morris G, Bell E, Hamilton A. A new paradigm for achieving a rapid antidepressant response. Drugs. 2020;80(8):755–64. https://doi.org/10.1007/s40265-020-01303-1.

    Article  CAS  PubMed  Google Scholar 

  4. Zuckerbrot RA, Jensen PS. Improving recognition of adolescent depression in primary care. Arch pediatr & Adolesc med. 2006;160(7):694–704. https://doi.org/10.1001/archpedi.160.7.694.

    Article  Google Scholar 

  5. Gunnell D, Kidger J, Elvidge H: Adolescent mental health in crisis. In.: British medical journal publishing Group; 2018.

  6. Copeland WE, Shanahan L, Costello EJ, Angold A. Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Arch Genl Psychiatr. 2009;66(7):764–72. https://doi.org/10.1001/archgenpsychiatry.2009.85.

    Article  Google Scholar 

  7. Thapar A, Collishaw S, Pine DS, Thapar AK: Depression in adolescence. Lancet. 2012;379(9820):1056–1067. https://doi.org/10.1016/s0140-6736(11)60871-4.

  8. Control CfD, Prevention: National center for injury prevention and control. Web-based injury statistics query and reporting system (WISQARS). http://www.cdc.gov/injury/wisqars/ Accessed on May 2014, 29:2014.

  9. Holtzheimer PE, Mayberg HS. Stuck in a rut: rethinking depression and its treatment. Trends Neurosci. 2011;34(1):1–9. https://doi.org/10.1016/j.tins.2010.10.004.

    Article  CAS  PubMed  Google Scholar 

  10. Singham T, Viding E, Schoeler T, Arseneault L, Ronald A, Cecil CM, et al. Concurrent and longitudinal contribution of exposure to bullying in childhood to mental health: the role of vulnerability and resilience. JAMA Psychiatry. 2017;74(11):1112–9. https://doi.org/10.1001/jamapsychiatry.2017.2678.

  11. Shin C, Kim Y, Park S, Yoon S, Ko Y-H, Kim Y-K, et al. Prevalence and associated factors of depression in general population of Korea: results from the Korea National Health and nutrition examination survey, 2014. J Korean Med Sci. 2017;32(11):1861–9. https://doi.org/10.3346/jkms.2017.32.11.1861.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Mcdermott RC, Fruh SM, Williams S, Hauff C, Graves RJ, Melnyk BM, et al. Nursing students’ resilience, depression, well-being, and academic distress: testing a moderated mediation model. J Adv Nurs. 2020;76(12):3385–97. https://doi.org/10.1111/jan.14531.

  13. Yang X, Zhou Z, Liu Q, Fan C. Mobile phone addiction and adolescents’ anxiety and depression: the moderating role of mindfulness. J Child Fam Stud. 2019;28(3):822–30. https://doi.org/10.1007/s10826-018-01323-2.

    Article  Google Scholar 

  14. Ma W. Relationship among life events, self-efficacy and emotion in middle school students. Chin J Clin Psychol. 2006;14(3):303.

    Google Scholar 

  15. Gariepy G, Honkaniemi H, Quesnel-Vallee A. Social support and protection from depression: systematic review of current findings in Western countries. Br J Psychiatry. 2016;209(4):284–93. https://doi.org/10.1192/bjp.bp.115.169094.

    Article  PubMed  Google Scholar 

  16. McDonald K. Social support and mental health in LGBTQ adolescents: a review of the literature. Issues Ment Health Nurs. 2018;39(1):16–29. https://doi.org/10.1080/01612840.2017.1398283.

    Article  PubMed  Google Scholar 

  17. Marsh IC, Chan SW, MacBeth A. Self-compassion and psychological distress in adolescents—a meta-analysis. Mindfulness. 2018;9(4):1011–27. https://doi.org/10.1007/s12671-017-0850-7.

    Article  PubMed  Google Scholar 

  18. Edman JL, Lynch WC, Yates A. The impact of exercise performance dissatisfaction and physical exercise on symptoms of depression among college students: a gender comparison. J Psychol. 2014;148(1):23–35. https://doi.org/10.1080/00223980.2012.737871.

    Article  PubMed  Google Scholar 

  19. Scheier MF, Carver CS. Optimism, coping, and health: assessment and implications of generalized outcome expectancies. Health Psychol. 1985;4(3):219–47. https://doi.org/10.1037/0278-6133.4.3.219.

    Article  CAS  PubMed  Google Scholar 

  20. Weersing VR, Shamseddeen W, Garber J, Hollon SD, Clarke GN, Beardslee WR, et al. Prevention of depression in at-risk adolescents: predictors and moderators of acute effects. J Am Acad of Child Adolesc Psychiatr. 2016;55(3):219–26. https://doi.org/10.1016/j.jaac.2015.12.015.

    Article  Google Scholar 

  21. Bluth K, Gaylord SA, Campo RA, Mullarkey MC, Hobbs L. Making friends with yourself: a mixed methods pilot study of a mindful self-compassion program for adolescents. Mindfulness. 2016;7(2):479–92. https://doi.org/10.1007/s12671-015-0476-6.

    Article  PubMed  Google Scholar 

  22. Firth J, Gangwisch JE, Borisini A, Wootton RE, Mayer EA. Food and mood: how do diet and nutrition affect mental wellbeing? BMJ. 2020;369. https://doi.org/10.1136/bmj.m2382.

  23. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. 1988;52(1):30–41. https://doi.org/10.1207/s15327752jpa5201_2.

    Article  Google Scholar 

  24. Matthews T, Danese A, Wertz J, Odgers CL, Ambler A, Moffitt TE, et al. Social isolation, loneliness and depression in young adulthood: a behavioural genetic analysis. Soc Psychiatry Psychiatr Epidemiol. 2016;51(3):339–48. https://doi.org/10.1007/s00127-016-1178-7.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Liu XC, Liu QL, Yang J, Chai FX, Wang AZ, Sun LM, et al. The reliability and validity analysis of the adolescent self-rating negative life events check list. Chin J Clin Psychol. 1997;1:34–6.

    CAS  Google Scholar 

  26. Xin X, Yao S. Validity and reliability of the adolescent self-rating life events checklist in middle school students. CMHJ (Chinese Mental Health Journal). 2015;5:355–60.

  27. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96. https://doi.org/10.2307/2136404.

    Article  CAS  PubMed  Google Scholar 

  28. Wang Z, Chen J, Boyd JE, Zhang H, Jia X, Qiu J, et al. Psychometric properties of the Chinese version of the perceived stress scale in policewomen. PLoS One. 2011;6(12):e28610. https://doi.org/10.1371/journal.pone.0028610.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the connor–Davidson resilience scale (CD-RISC): validation of a 10-item measure of resilience. J Trauma Stress. 2007;20(6):1019–28. https://doi.org/10.1002/jts.20271.

    Article  PubMed  Google Scholar 

  30. Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson resilience scale (CD-RISC). Depress Anxiety. 2003;18(2):76–82. https://doi.org/10.1002/da.10113.

    Article  PubMed  Google Scholar 

  31. Schwarzer R, Jerusalem M: Generalized self-efficacy scale. Generalized self-efficacy scale. In: Weinman J, Wright S, Johnston M, editors. Measures Health Psychol 1995, 1(1):35–37.

  32. Scholz U, Doña BG, Sud S, Schwarzer R. Is general self-efficacy a universal construct? Psychometric findings from 25 countries. Eur Psychol Assess. 2002;18(3):242–51. https://doi.org/10.1027//1015-5759.18.3.242.

    Article  Google Scholar 

  33. Neff KD. The development and validation of a scale to measure self-compassion. Self Identity. 2003;2(3):223–50. https://doi.org/10.1080/15298860309027.

  34. Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the self-compassion scale. Clin Psychol Psychother. 2011;18(3):250–5. https://doi.org/10.1002/cpp.702.

    Article  PubMed  Google Scholar 

  35. Homan KJ, Sirois FM. Self-compassion and physical health: exploring the roles of perceived stress and health-promoting behaviors. Health Psychol Open. 2017;4(2):2055102917729542. https://doi.org/10.1177/2055102917729542.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Neff KD, Beretvas SN. The role of self-compassion in romantic relationships. Self Identity. 2013;12(1):78–98. https://doi.org/10.1080/15298868.2011.639548.

    Article  Google Scholar 

  37. Baer RA, Smith GT, Hopkins J, Krietemeyer J, Toney L. Using self-report assessment methods to explore facets of mindfulness. Assessment. 2006;13(1):27–45. https://doi.org/10.1177/1073191105283504.

    Article  PubMed  Google Scholar 

  38. Gosling SD, Rentfrow PJ, Swann Jr WB: A very brief measure of the big-five personality domains. J Res Pers 2003; 37(6):504–528. https://doi.org/10.1016/s0092-6566(03)00046-1.

  39. Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the life orientation test. J Pers Soc Psychol. 1994;67(6):1063–78. https://doi.org/10.1037/0022-3514.67.6.1063.

    Article  CAS  PubMed  Google Scholar 

  40. Wang S, Zhao Y, Cheng B, Wang X, Yang X, Chen T, et al. The optimistic brain: trait optimism mediates the influence of resting-state brain activity and connectivity on anxiety in late adolescence. Hum Brain Mapp. 2018;39(10):3943–55. https://doi.org/10.1002/hbm.24222.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Indu PS, Anilkumar TV, Vijayakumar K, Kumar K, Sarma PS, Remadevi S, et al. Reliability and validity of PHQ-9 when administered by health workers for depression screening among women in primary care. Asian J Psychiatr. 2018;37:10–4. https://doi.org/10.1016/j.ajp.2018.07.021.

  43. Golnaraghi S, Zangenehmadar Z, Moselhi O, Alkass S. Application of artificial neural network (s) in predicting formwork labour productivity. Adv Civ Eng. 2019;2019:1–11. https://doi.org/10.1155/2019/5972620.

    Article  Google Scholar 

  44. Agresti A: Categorical data analysis, vol. 482: John Wiley & Sons; 2003.

  45. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36. https://doi.org/10.1148/radiology.143.1.7063747.

    Article  CAS  PubMed  Google Scholar 

  46. Wu J, Tong H, Liu Z, Tao J, Chen L, Chan CC, et al. Neurobiological effects of perceived stress are different between adolescents and middle-aged adults. Brain Imaging Behav. 2021;15(2):846–54. https://doi.org/10.1007/s11682-020-00294-7.

    Article  PubMed  Google Scholar 

  47. Alarcon GM, Bowling NA, Khazon S. Great expectations: a meta-analytic examination of optimism and hope. Pers Individ Dif. 2013;54(7):821–7. https://doi.org/10.1016/j.paid.2012.12.004.

    Article  Google Scholar 

  48. Carver CS, Scheier MF. Dispositional optimism. Trends Cogn Sci. 2014;18(6):293–9. https://doi.org/10.1016/j.tics.2014.02.003.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Neff KD, Long P, Knox MC, Davidson O, Kuchar A, Costigan A, et al. The forest and the trees: examining the association of self-compassion and its positive and negative components with psychological functioning. Self Identity. 2018;17(6):627–45. https://doi.org/10.1080/15298868.2018.1436587.

    Article  Google Scholar 

  50. Smith JL. Self-compassion and resilience in senior living residents. Seniors Hous Care J. 2015;23(1):17–31.

    Google Scholar 

  51. Ungar M. Resilience across cultures. Br J of Soc Work. 2008;38(2):218–35. https://doi.org/10.1093/bjsw/bcl343.

    Article  Google Scholar 

  52. Arslan G. Psychological maltreatment, emotional and behavioral problems in adolescents: the mediating role of resilience and self-esteem. Child Abuse Negl. 2016;52:200–9. https://doi.org/10.1016/j.chiabu.2015.09.010.

    Article  PubMed  Google Scholar 

  53. Joyce S, Shand F, Tighe J, Laurent SJ, Bryant RA, Harvey SB: Road to resilience: a systematic review and meta-analysis of resilience training programmes and interventions. BMJ open. 2018;8(6):e017858. https://doi.org/10.1136/bmjopen-2017-017858.

  54. Dickson JM, Moberly NJ, O’Dea C, Field M. Goal fluency, pessimism and disengagement in depression. PLoS One. 2016;11(11):e0166259. https://doi.org/10.1371/journal.pone.0166259.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  55. Steinberg DB, Simon VA. A comparison of hobbies and organized activities among low income urban adolescents. J Child Fam Stud. 2019;28(5):1182–95. https://doi.org/10.1007/s10826-019-01365-0.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Brooks R. The search for islands of competence: a metaphor of hope and strength. Reclaim Child Youth. 2007;16(1):11–3.

    Google Scholar 

  57. Jamieson JP, Peters BJ, Greenwood EJ, Altose AJ. Reappraising stress arousal improves performance and reduces evaluation anxiety in classroom exam situations. Soc Psychol Personal Sci. 2016;7(6):579–87. https://doi.org/10.1177/1948550616644656.

    Article  Google Scholar 

  58. Trigueros R, Padilla AM, Aguilar-Parra JM, Rocamora P, Morales-Gázquez MJ, López-Liria R: The Influence of Emotional Intelligence on Resilience, Test Anxiety, Academic Stress and the Mediterranean Diet. A Study with University Students. Int Environ Res Public Health. 2020; 17(6):2071. https://doi.org/10.3390/ijerph17062071.

  59. Sarı SA, Bilek G, Çelik E. Test anxiety and self-esteem in senior high school students: a cross-sectional study. Nord J Psychiatry. 2018;72(2):84–8. https://doi.org/10.1080/08039488.2017.1389986.

    Article  PubMed  Google Scholar 

  60. Ruusunen A: Diet and depression: an epidemiological study. Itä-Suomen yliopisto; 2013.

  61. Salari-Moghaddam A, Saneei P, Larijani B, Esmaillzadeh A. Glycemic index, glycemic load, and depression: a systematic review and meta-analysis. Eur J Clin Nutr. 2019;73(3):356–65. https://doi.org/10.1038/s41430-018-0258-z.

    Article  CAS  PubMed  Google Scholar 

  62. Peng S, Wu K, Wang J, Chuang J, Peng S, Lai Y. Predicting postoperative nausea and vomiting with the application of an artificial neural network. BJA. 2007;98(1):60–5. https://doi.org/10.1093/bja/ael282.

    Article  CAS  PubMed  Google Scholar 

  63. Nayak BS, Sahu PK. Socio-demographic and educational factors associated with depression, anxiety and stress among health professions students. Psychol Health Med. 2021;9:1–6. https://doi.org/10.1080/13548506.2021.1896760.

    Article  Google Scholar 

  64. Hoeppner BB, Kelly JF, Urbanoski KA, Slaymaker V: Comparative utility of a single-item versus multiple-item measure of self-efficacy in predicting relapse among young adults. J Subst Abuse Treat. 2011; 41(3):305–312. https://doi.org/10.1016/j.jsat.2011.04.005

Download references

Acknowledgements

Many thanks were given to GZ Gu and XP Miao from middle schools, who offered help in data collection. Warm thanks were also given to XY Geng majored in computer science and artificial intelligence from NanTong University, who gave the revision suggestions in machine learning methods. The participants for their contribution to the study were also acknowledged.

Funding

The study was supported by the project from Ministry of Education of China.

Author information

Authors and Affiliations

Authors

Contributions

FFZ: Conceptualization, design, data collection, data analysis, data interpretation, funding acquisition, Writing - original draft, review & editing. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Fang-Fang Zhao.

Ethics declarations

Ethics approval and consent to participate

The study obtains the approval of the ethical review of Nantong University in Jiangsu Province, eastern China (2019–17/2020–21). With informed consent, the students’ participation of the survey was totally voluntary. Informed consent online was obtained from their guardians before data collection, considering that the investigation was started in school thus school teachers in charge of them were responsible for them. The ethical committee for the study approved this method of obtaining consent. The instruments used in the study were obtained approval of original authors (Copyright holders) when necessary. The study was conducted following the STROBE checklist.

Consent for publication

Not applicable.

Competing interests

The author has no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, FF. Artificial neural network application for identifying risk of depression in high school students: a cross-sectional study. BMC Psychiatry 21, 517 (2021). https://doi.org/10.1186/s12888-021-03531-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-021-03531-5

Keywords