- Research article
- Open Access
Delayed school progression and mental health problems in adolescence: a population-based study in 10,803 adolescents
BMC Psychiatry volume 14, Article number: 244 (2014)
Accumulating evidence suggests that several adult mental disorders, particularly psychoses, are preceded by impairments in cognitive function, reflected in scholastic underachievement. This study investigates the association between scholastic underachievement and general mental health problems in adolescence, using delay in school progression as a marker of poor scholastic performance.
Cross-sectional secondary school survey comprising 10,803 adolescents. Participants completed the Strengths and Difficulties Questionnaire (SDQ) to assess mental health problems. The association of delayed school progression with the SDQ was investigated using logistic regression with SDQ as outcome and delayed school progression as primary exposure of interest while adjusting for socio-demographic characteristics, adverse life events, school-related factors, risk taking behaviour, healthy lifestyle and physical health.
Unadjusted analysis showed an association between delayed school progression and total mental health problems (OR 1.83, 95% CI 1.27 – 2.63) in adolescents. After adjusting for other risk factors (socio-demographic factors and life events) in a logistic regression model the association between delayed school progression en mental health problems was attenuated (OR 1.33, 95% CI 0.86 – 2.05).
Delayed school progression is associated with general mental health problems in adolescence, but this relationship is heavily confounded by other factors. A causal relationship between impaired cognitive function such as poor scholastic performance and general mental health at adolescence is less likely and delayed school progression may merely be considered an indicator of risk for mental health problems.
Mental health difficulties are both common and debilitating in childhood. About one-third of all children experience mental health problems that affect everyday functioning ,. Without adequate treatment these symptoms often persist into adulthood . Since approximately fifty percent of all lifetime mental disorders arise in the mid-teens , recent attention has focused on early detection and intervention during adolescence.
Several studies show that poor cognitive function or intellectual achievement is present before the onset of several mental disorders. Low intelligence coefficient (IQ) has predominantly been associated with later development of schizophrenia (reviewed in ). Similar associations have been found for other psychiatric illnesses such as severe depression  and anxiety disorders . Indeed, some studies suggest that pre-morbid low intellectual functioning is related to overall risk of psychiatric disorders in adulthood ,. Various mechanisms have been suggested to underlie this relationship, including the hypothesis that impairments in IQ or other cognitive functioning reflect neurodevelopmental changes which may predispose to psychiatric disorders ,.
Several studies have demonstrated associations between poor scholastic achievement and mental disorders during adolescence or adulthood -. Repeating a grade is previously used as an indicator of scholastic underachievement and is for instance related to the risk of schizophrenia and other psychoses . However, few studies investigated poor school achievement as an independent risk factor for the development of mental health problems during adolescence . We therefore studied the association between a delay in school progression and mental health problems in adolescents, and adjusted for potential confounders.
We conducted a cross-sectional population-based study of adolescents attending secondary schools in The Netherlands. The study population was an unselected sample of 10,803 adolescents at secondary school (age 12–18) who were routinely surveyed by the Community Health Service Central Netherlands & Eemland (GGD).
Dutch secondary school has four main levels of education that prepare for further education. For the purpose of this study we divided the group in those who were preparing for polytechnic or academic training and those that were focussing on vocational training. The survey took place during autumn 2007 and was conducted alongside prevention programs in all secondary schools in the province of Utrecht, excluding the City of Utrecht. The region includes both urban and rural areas; about 34% of the study population lives in an urban area. Participation was determined at school level and 45 schools (71% of the schools invited) participated. The most common reasons for schools not to participate were lack of time, change in management, or participation in other research projects. 84% of all students in the participating schools completed the questionnaire, non-response was mostly due to absence because of illness or truancy.
Institutional Review Board approval was not required for this study since it was an anonymous questionnaire obtained for public health purposes.
All students were asked to complete an anonymous digital questionnaire in the classroom.
Mental health problems
Mental health problems were defined as a score in the clinical range of the Dutch translation of the self-reported Strengths and Difficulties Questionnaire (SDQ) . The Dutch translation of the self-reported SDQ is validated . The SDQ has a specificity of 94.6% (95% CI 94.1-95.1) and a sensitivity of 63.3% (95% CI 59.7-66.9) to identify adolescents with a psychiatric disorder . The SDQ consists of 25 items on psychosocial attributes. Each item is scored on a 3-point scale with ‘not true’, ‘somewhat true’, and ‘certainly true’. These 25 items are divided into 5 subscales, each with 5 items: emotional symptoms, conduct problems, hyperactivity/ inattention, peer relationship problems, and pro-social behaviour. The summed score, excluding the items about pro-social behaviour, generates a total difficulties score, with a range of 0 to 40. The SDQ total difficulties score can be divided into normal (0–15), borderline (16–19) and clinical scores (20–40) . To identify those with clinically relevant symptoms, the outcome was dichotomized into normal to borderline and clinical.
Poor school achievement
We used delayed school progression as marker of previous poor school achievement. A student was considered a poor school achiever when his age was at least 1.5 years above the mean age for his grade. This stringent cut-off allowed us to identify adolescents who had failed to progress as expected to the next grade on at least one occasion at any stage of primary or secondary school .
Potential confounders were determined based on the literature and availability in the school survey which assessed poor school achievement and mental health problems. Potential confounding factors were categorized into six different subgroups: socio-demographic factors, adverse life events, school-related factors, risk taking behaviour, health & lifestyle and miscellaneous factors. The content of the questionnaires can be found in the Additional file 1.
Adverse life events
The following adverse life events were assessed using adolescents’ self-report: death of a first degree relative or another loved person, chronic disease or long lasting hospitalization of the adolescent himself or a first degree relative, parental alcohol problem or addiction, psychiatric disease in a first degree relative, parental divorce, domestic violence (between parents or victimizing the adolescent), molestation by someone other than the parent and sexual abuse .
The following school-related variables were measured: educational level at secondary school , bullying, victimization , school perception , truancy , perceived school safety , getting along with classmates and having close friends in school.
Risk taking behaviour
Substance use was assessed by questions about frequency of consumption of alcohol, tobacco, marijuana, other illicit drugs and addiction ,. Sexual risk taking behaviour was measured by condom use, lifetime multiple sexual partners and a history of sexually transmitted diseases (STDs).
Health and lifestyle
Healthy lifestyle was measured by seven variables: physical exercise, regular breakfast , fruit and vegetable consumption, overweight (BMI according to age), weight perception, excessive television/computer usage, absence at school due to illness and use of painkillers.
Family care, future perspective on life and parental involvement.
The SDQ was complete for 11,291 adolescents (247 incomplete cases (2.1%) were excluded). Also, data were missing for multiple sexual partners (477 missing cases (4.2%). Because of the relatively small amount of missing data casewise exclusion of missing cases was performed. Furthermore, outliers with age older than 20 were excluded (N = 10) as was one outlier with total SDQ score above 36. In total, data from 10,803 cases were analyzed.
All data were analysed using SPSS 19.0 for Windows. Bivariate non-parametric correlations were performed to identify multicollinearity between different variables (Kendall’s τ > 0.8) . As described above, potential confounders were selected based on literature. We used the large set of potential risk factors to perform a data-driven approach. Therefore, we divided the analysis in three different phases. First, we analyzed the crude unadjusted association between delayed school progression and current mental health problems. The crude odds ratio (OR) with 95% confidence interval (CI) was determined using logistic regression analysis. Secondly, covariates were tested as to whether they (1) were significantly correlated with both poor school achievement and mental health problems, and (2) altered the association between delayed school progression and mental health problems by at least ten percent . The final step in the analysis was the composition of a predictive model using multivariate logistic regression adjusting for only the confounding factors that were obtained in step two of the analysis. Significance level was set as p = 0.05.
The sample consisted of 10,803 participants, 99% of the participants were between 12 and 18 years old (range: 10–19 years), with a mean age of 14.2 (SD = 1.6) and 49.8% male. Gender was equally distributed. Most participants were Dutch and living with both parents. 35.4 % of the pupils were identified as delayed in their school progression. Male gender (OR 1.40, 95% CI 1.15 – 1.69) was associated with delayed school progression. Adolescents with a non-Dutch ethnicity had higher odds for a delay in school progression (OR 2.77, OR 95% CI 2.27 – 3.73). Mental health problems, however, were equally distributed by age, gender and ethnicity. Bivariate analysis did not show multicollinearity between different variables. Table 1 shows the demographic characteristics of this population; information about other variables is added to the Additional file 1: Table S1. Both of these tables show the distribution of variables analysed in the whole sample and clinical SDQ group, plus their relation with mental health problems.
Analysis of potential confounders yielded a subgroup of variables which were added to the logistic models. (We selected only those confounders that were correlated with delayed school progression and SDQ and altered the association between delayed school progression and SDQ). These covariates were mainly adverse life events: sexual abuse, domestic violence and parental problems with alcohol or addiction. Other confounders were perceived problems with money or income and irregular breakfast. Since many control variables were related to age, gender and ethnicity, these factors were also included in the prediction model.
Table 2 shows both the unadjusted and the adjusted prediction model. The unadjusted model consists of the crude association between delayed school progression and mental health problems (OR 1.83, 95% CI 1.27-2.62). In the adjusted model all the potential confounding factors were entered together. In the adjusted logistic regression model the association between delayed school progression and clinical SDQ was not statistically significant (OR 1.38, 95% CI 0.91-2.10). Since the association was not longer significant, analysis of factors that might also act as mediating factors was redundant.
In this cross-sectional study we investigated the association between scholastic achievement and current mental health problems in adolescents. We demonstrated that delayed school progression, used as a proxy for poor school achievement, was associated with adolescent mental health problems. After adjusting for potential confounding factors the association was no longer significant. These findings indicate a possible role for delayed school progression as a risk marker for mental health problems at adolescence, but did not provide evidence that delayed school progression is a causal risk factor for mental health problems. However this does not rule out the possibility that school performance may be associated with specific psychiatric outcomes such as schizophrenia.
The factors that we identified as confounders are important to consider in further studies.
Strengths and limitations
The main strengths of this study were the large population-based sample with adolescents of both genders and the richness of the data, particularly on potential confounders. Furthermore, a delay in school progression is an objective measure and not subject to recall bias. The response rate was generally good. Moreover, the association between delayed school progression and mental health problems might have been stronger when non-responders would have joined the study since truants or frequently ill students are probably more likely to have high SDQ scores and problems with scholastic achievement.
This study also has limitations. Delay in school progression was a rather crude proxy for poor school performance and children with delayed school progression probably constituted a heterogeneous group, since the delay could have been the result of enrolling in primary school at a relatively old age or language problems. We reduced this problem considerably by adjusting for covariates, such as ethnicity, and by picking a stringent cut-off point for delayed school progression to include only children with a definite history of scholastic underperformance. Another limitation was the self-reported SDQ as an outcome measure. Although validated and used widely as a measure for mental health problems, complementary information from teachers and parents would improve the sensitivity and specificity. Furthermore, the prevalence of mental health problems in our study population was low compared with international studies using the SDQ . Dutch children have a tendency to score lower on the SDQ than UK children; about 6% of all Dutch children score above the UK cut-off point  and in our sample 4.5% of the participants scored in the clinical range. Additionally, the included children were aged between 10 and 19 years old (99% between 12 and 18 years) and mental health problems may differ between the younger and older participants. This study was also limited by its cross-sectional design. Delay in school progression and mental health problems were measured at the same moment, thus we cannot rule out that mental health problems could have preceded the delay in school progression earlier in youth. However, previous prospective studies on educational performance showed that poor educational attainment often predicts development of psychiatric disorders -.
Interpretation of findings
Contrary to most previous studies addressing poor educational achievement and psychiatric problems, we found no association after adjusting for confounders. This finding is in contrast to previous studies which have shown associations between poor school performance and later psychosis. It is possible that the adolescent age is too early to detect the effects of neurobiological changes on mental health. Furthermore, we focused on general mental health problems, instead of the development of specific (mainly psychotic) disorders in the majority of previous studies.
In addition, poor school achievement can be seen as an event that might mediate the impact of other risk factors for mental health problems. Thus, poor school achievement might function as a trigger for alterations in the causal pathway of genetic and environmental factors underlying neurobiological changes leading to mental disorders.
Lastly, most studies used other measures of poor school performance, like school level , literacy skills  and school grades ,. These measures may be more related to intellectual functioning than a delay in school progression because the latter is more affected by other aspects such as social and emotional development during school-age. Thus, further research is needed to examine the potential role of school performance as an intermediate factor for different risk factors of mental health problems and longitudinal effects of poor school performance.
Overall our results showed that delayed school progression is a risk marker of mental health problems in school aged children, but that this association is largely explained by confounding. This is consistent with the view that poor school performance is a risk indicator for particular psychiatric disorders but not for general mental health problems in adolescents.
Merikangas KR, Nakamura EF, Kessler RC: Epidemiology of mental disorders in children and adolescents. Dialogues Clin Neurosci. 2009, 11: 7-20.
Crone MR, Vogels AG, Hoekstra F, Treffers PD, Reijneveld SA: A comparison of four scoring methods based on the parent-rated Strengths and Difficulties Questionnaire as used in the Dutch preventive child health care system. BMC Public Health. 2008, 8: 106-10.1186/1471-2458-8-106.
Hofstra MB, Van der Ende J, Verhulst FC: Continuity and change of psychopathology from childhood into adulthood: a 14-year follow-up study. J Am Acad Child Adolesc Psychiatry. 2000, 39: 850-858. 10.1097/00004583-200007000-00013.
Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustun TB: Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007, 20: 359-364. 10.1097/YCO.0b013e32816ebc8c.
MacCabe JH: Population-based cohort studies on premorbid cognitive function in schizophrenia. Epidemiol Rev. 2008, 30: 77-83. 10.1093/epirev/mxn007.
Zammit S, Allebeck P, David AS, Dalman C, Hemmingsson T, Lundberg I, Lewis G: A longitudinal study of premorbid IQ Score and risk of developing schizophrenia, bipolar disorder, severe depression, and other nonaffective psychoses. Arch Gen Psychiatry. 2004, 61: 354-360. 10.1001/archpsyc.61.4.354.
Koenen KC, Moffitt TE, Roberts AL, Martin LT, Kubzansky L, Harrington H, Poulton R, Caspi A: Childhood IQ and adult mental disorders: a test of the cognitive reserve hypothesis. Am J Psychiatry. 2009, 166: 50-57. 10.1176/appi.ajp.2008.08030343.
Batty GD, Mortensen EL, Osler M: Childhood IQ in relation to later psychiatric disorder: evidence from a Danish birth cohort study. Br J Psychiatry. 2005, 187: 180-181. 10.1192/bjp.187.2.180.
Walker NP, McConville PM, Hunter D, Deary IJ, Whalley LJ: Childhood mental ability and lifetime psychiatric contact: A 66-year follow-up study of the 1932 Scottish Mental Ability Survey. Intelligence. 2002, 30: 233-245. 10.1016/S0160-2896(01)00098-8.
Reichenberg A, Weiser M, Rabinowitz J, Caspi A, Schmeidler J, Mark M, Kaplan Z, Davidson M: A population-based cohort study of premorbid intellectual, language, and behavioral functioning in patients with schizophrenia, schizoaffective disorder, and nonpsychotic bipolar disorder. Am J Psychiatry. 2002, 159: 2027-2035. 10.1176/appi.ajp.159.12.2027.
Lawrie SM, Olabi B, Hall J, McIntosh AM: Do we have any solid evidence of clinical utility about the pathophysiology of schizophrenia?. World Psychiatry. 2011, 10: 19-31.
Hameed MA, Lewis AJ, Sullivan S, Zammit S: Child literacy and psychotic experiences in early adolescence: findings from the ALSPAC study. Schizophr Res. 2013, 145 (1–3): 88-94. 10.1016/j.schres.2012.12.025.
Chong SA, Subramaniam M, Lee IM, Pek E, Cheok C, Verma S, Wong J: Academic attainment: a predictor of psychiatric disorders?. Soc Psychiatry Psychiatr Epidemiol. 2009, 44: 999-1004. 10.1007/s00127-009-0027-3.
MacCabe JH, Lambe MP, Cnattingius S, Torrang A, Bjork C, Sham PC, David AS, Murray RM, Hultman CM: Scholastic achievement at age 16 and risk of schizophrenia and other psychoses: a national cohort study. Psychol Med. 2008, 38: 1133-1140. 10.1017/S0033291707002048.
Isohanni I, Jarvelin MR, Nieminen P, Jones P, Rantakallio P, Jokelainen J, Isohanni M: School performance as a predictor of psychiatric hospitalization in adult life. A 28-year follow-up in the Northern Finland 1966 Birth Cohort. Psychol Med. 1998, 28: 967-974. 10.1017/S0033291798006928.
Goodman R, Meltzer H, Bailey V: The strengths and difficulties questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry. 1998, 7: 125-130. 10.1007/s007870050057.
Muris P, Meesters C, van den Berg F: The Strengths and Difficulties Questionnaire (SDQ)–further evidence for its reliability and validity in a community sample of dutch children and adolescents. Eur Child Adolesc Psychiatry. 2003, 12: 1-8. 10.1007/s00787-003-0298-2.
Goodman R, Ford T, Simmons H, Gatward R, Meltzer H: Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000, 177: 534-539. 10.1192/bjp.177.6.534.
Timmermans M, van Lier P, Koot H: Pathways of behavior problems from childhood to late adolescence leading to delinquency and academic underachievement. J Clin Child Adolesc Psychol. 2009, 38: 630-638. 10.1080/15374410903103502.
Korkeila J, Lehtinen V, Bijl R, Dalgard OS, Kovess V, Morgan A, Salize H: Establishing a set of mental health indicators for Europe. Scand J Public Health. 2003, 31: 451-459. 10.1080/14034940210165208.
Peen J, Dekker J: Is urbanicity an environmental risk-factor for psychiatric disorders?. Lancet. 2004, 363: 2012-2013. 10.1016/S0140-6736(04)16486-6.
Rothon C, Head J, Klineberg E, Stansfeld S: Can social support protect bullied adolescents from adverse outcomes? A prospective study on the effects of bullying on the educational achievement and mental health of adolescents at secondary schools in East London. J Adolesc. 2011, 34: 579-588. 10.1016/j.adolescence.2010.02.007.
Bond L, Butler H, Thomas L, Carlin J, Glover S, Bowes G, Patton G: Social and school connectedness in early secondary school as predictors of late teenage substance use, mental health, and academic outcomes. J Adolesc Health. 2007, 40: 357.9-357.18. 10.1016/j.jadohealth.2006.10.013.
Nijs M, Bun C, Tempelaar W, De Wit N, Burger H, Plevier C, Boks M: Perceived school safety is strongly associated with adolescent’s mental health problems. Community Ment Health J. 2014, 50 (2): 127-134. 10.1007/s10597-013-9599-1.
Hibbett A, Fogelman K: Future lives of truants: family formation and health-related behaviour. Br J Educ Psychol. 1990, 60 (Pt 2): 171-179. 10.1111/j.2044-8279.1990.tb00934.x.
Van Gastel WA, Tempelaar W, Bun C, Schubart CD, Kahn RS, Plevier C, Boks M: Cannabis use as an indicator of risk for mental health problems in adolescents: a cross-sectional population-based study at secondary schools. Psychol Med. 2012, 3: 1-8.
Goodman A: Substance use and common child mental health problems: examining longitudinal associations in a British sample. Addiction. 2010, 105: 1484-96. 10.1111/j.1360-0443.2010.02981.x.
Lien L: Is breakfast consumption related to mental distress and academic performance in adolescents?. Public Health Nutr. 2007, 10: 422-428. 10.1017/S1368980007258550.
Vittinghoff E, Glidden D, Shiboski S, McCulloch CE: Regression methods in biostatistics: linear, logistic, survival and repeated measures models. 2005, Springer, New York
Greenland S: Modeling and variable selection in epidemiologic analysis. Am J Public Health. 1989, 79: 340-349. 10.2105/AJPH.79.3.340.
We are grateful to the employees of the Municipal Health Service Central Netherlands for collection of the data.
The authors declare that they have no competing interests.
WT: participated in the design of the study, performed the statistical analysis and drafted the manuscript. CO: participated in the design of the study, performed the statistical analysis and drafted the manuscript. CB: participated in the conception, design and acquisition of data. CP: participated in the conception, design and acquisition of data. WG: participated in the analysis and interpretation of data. JM: participated in the design of the study, analysis and interpretation of data. RK: conceived of the study and coordination and helped to draft the manuscript. MB: conceived of the study, participated in its design and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1: Detailed content of the questionnaire and Supplementary table: distribution of all variables in the sample, clinical SDQ group and their association with SDQ.(PDF 129 KB)
About this article
Cite this article
Tempelaar, W.M., Otjes, C.P., Bun, C.J. et al. Delayed school progression and mental health problems in adolescence: a population-based study in 10,803 adolescents. BMC Psychiatry 14, 244 (2014). https://doi.org/10.1186/s12888-014-0244-5
- Delayed school progression
- General mental health and SDQ