- Research article
- Open Access
- Open Peer Review
Delayed school progression and mental health problems in adolescence: a population-based study in 10,803 adolescents
© Tempelaar et al.; licensee BioMed Central Ltd. 2014
- Received: 10 July 2013
- Accepted: 19 August 2014
- Published: 14 September 2014
Accumulating evidence suggests that several adult mental disorders, particularly psychoses, are preceded by impairments in cognitive function, reflected in scholastic underachievement. This study investigates the association between scholastic underachievement and general mental health problems in adolescence, using delay in school progression as a marker of poor scholastic performance.
Cross-sectional secondary school survey comprising 10,803 adolescents. Participants completed the Strengths and Difficulties Questionnaire (SDQ) to assess mental health problems. The association of delayed school progression with the SDQ was investigated using logistic regression with SDQ as outcome and delayed school progression as primary exposure of interest while adjusting for socio-demographic characteristics, adverse life events, school-related factors, risk taking behaviour, healthy lifestyle and physical health.
Unadjusted analysis showed an association between delayed school progression and total mental health problems (OR 1.83, 95% CI 1.27 – 2.63) in adolescents. After adjusting for other risk factors (socio-demographic factors and life events) in a logistic regression model the association between delayed school progression en mental health problems was attenuated (OR 1.33, 95% CI 0.86 – 2.05).
Delayed school progression is associated with general mental health problems in adolescence, but this relationship is heavily confounded by other factors. A causal relationship between impaired cognitive function such as poor scholastic performance and general mental health at adolescence is less likely and delayed school progression may merely be considered an indicator of risk for mental health problems.
- Delayed school progression
- General mental health and SDQ
Mental health difficulties are both common and debilitating in childhood. About one-third of all children experience mental health problems that affect everyday functioning ,. Without adequate treatment these symptoms often persist into adulthood . Since approximately fifty percent of all lifetime mental disorders arise in the mid-teens , recent attention has focused on early detection and intervention during adolescence.
Several studies show that poor cognitive function or intellectual achievement is present before the onset of several mental disorders. Low intelligence coefficient (IQ) has predominantly been associated with later development of schizophrenia (reviewed in ). Similar associations have been found for other psychiatric illnesses such as severe depression  and anxiety disorders . Indeed, some studies suggest that pre-morbid low intellectual functioning is related to overall risk of psychiatric disorders in adulthood ,. Various mechanisms have been suggested to underlie this relationship, including the hypothesis that impairments in IQ or other cognitive functioning reflect neurodevelopmental changes which may predispose to psychiatric disorders ,.
Several studies have demonstrated associations between poor scholastic achievement and mental disorders during adolescence or adulthood -. Repeating a grade is previously used as an indicator of scholastic underachievement and is for instance related to the risk of schizophrenia and other psychoses . However, few studies investigated poor school achievement as an independent risk factor for the development of mental health problems during adolescence . We therefore studied the association between a delay in school progression and mental health problems in adolescents, and adjusted for potential confounders.
We conducted a cross-sectional population-based study of adolescents attending secondary schools in The Netherlands. The study population was an unselected sample of 10,803 adolescents at secondary school (age 12–18) who were routinely surveyed by the Community Health Service Central Netherlands & Eemland (GGD).
Dutch secondary school has four main levels of education that prepare for further education. For the purpose of this study we divided the group in those who were preparing for polytechnic or academic training and those that were focussing on vocational training. The survey took place during autumn 2007 and was conducted alongside prevention programs in all secondary schools in the province of Utrecht, excluding the City of Utrecht. The region includes both urban and rural areas; about 34% of the study population lives in an urban area. Participation was determined at school level and 45 schools (71% of the schools invited) participated. The most common reasons for schools not to participate were lack of time, change in management, or participation in other research projects. 84% of all students in the participating schools completed the questionnaire, non-response was mostly due to absence because of illness or truancy.
Institutional Review Board approval was not required for this study since it was an anonymous questionnaire obtained for public health purposes.
All students were asked to complete an anonymous digital questionnaire in the classroom.
Mental health problems
Mental health problems were defined as a score in the clinical range of the Dutch translation of the self-reported Strengths and Difficulties Questionnaire (SDQ) . The Dutch translation of the self-reported SDQ is validated . The SDQ has a specificity of 94.6% (95% CI 94.1-95.1) and a sensitivity of 63.3% (95% CI 59.7-66.9) to identify adolescents with a psychiatric disorder . The SDQ consists of 25 items on psychosocial attributes. Each item is scored on a 3-point scale with ‘not true’, ‘somewhat true’, and ‘certainly true’. These 25 items are divided into 5 subscales, each with 5 items: emotional symptoms, conduct problems, hyperactivity/ inattention, peer relationship problems, and pro-social behaviour. The summed score, excluding the items about pro-social behaviour, generates a total difficulties score, with a range of 0 to 40. The SDQ total difficulties score can be divided into normal (0–15), borderline (16–19) and clinical scores (20–40) . To identify those with clinically relevant symptoms, the outcome was dichotomized into normal to borderline and clinical.
Poor school achievement
We used delayed school progression as marker of previous poor school achievement. A student was considered a poor school achiever when his age was at least 1.5 years above the mean age for his grade. This stringent cut-off allowed us to identify adolescents who had failed to progress as expected to the next grade on at least one occasion at any stage of primary or secondary school .
Potential confounders were determined based on the literature and availability in the school survey which assessed poor school achievement and mental health problems. Potential confounding factors were categorized into six different subgroups: socio-demographic factors, adverse life events, school-related factors, risk taking behaviour, health & lifestyle and miscellaneous factors. The content of the questionnaires can be found in the Additional file 1.
Adverse life events
The following adverse life events were assessed using adolescents’ self-report: death of a first degree relative or another loved person, chronic disease or long lasting hospitalization of the adolescent himself or a first degree relative, parental alcohol problem or addiction, psychiatric disease in a first degree relative, parental divorce, domestic violence (between parents or victimizing the adolescent), molestation by someone other than the parent and sexual abuse .
The following school-related variables were measured: educational level at secondary school , bullying, victimization , school perception , truancy , perceived school safety , getting along with classmates and having close friends in school.
Risk taking behaviour
Substance use was assessed by questions about frequency of consumption of alcohol, tobacco, marijuana, other illicit drugs and addiction ,. Sexual risk taking behaviour was measured by condom use, lifetime multiple sexual partners and a history of sexually transmitted diseases (STDs).
Health and lifestyle
Healthy lifestyle was measured by seven variables: physical exercise, regular breakfast , fruit and vegetable consumption, overweight (BMI according to age), weight perception, excessive television/computer usage, absence at school due to illness and use of painkillers.
Family care, future perspective on life and parental involvement.
The SDQ was complete for 11,291 adolescents (247 incomplete cases (2.1%) were excluded). Also, data were missing for multiple sexual partners (477 missing cases (4.2%). Because of the relatively small amount of missing data casewise exclusion of missing cases was performed. Furthermore, outliers with age older than 20 were excluded (N = 10) as was one outlier with total SDQ score above 36. In total, data from 10,803 cases were analyzed.
All data were analysed using SPSS 19.0 for Windows. Bivariate non-parametric correlations were performed to identify multicollinearity between different variables (Kendall’s τ > 0.8) . As described above, potential confounders were selected based on literature. We used the large set of potential risk factors to perform a data-driven approach. Therefore, we divided the analysis in three different phases. First, we analyzed the crude unadjusted association between delayed school progression and current mental health problems. The crude odds ratio (OR) with 95% confidence interval (CI) was determined using logistic regression analysis. Secondly, covariates were tested as to whether they (1) were significantly correlated with both poor school achievement and mental health problems, and (2) altered the association between delayed school progression and mental health problems by at least ten percent . The final step in the analysis was the composition of a predictive model using multivariate logistic regression adjusting for only the confounding factors that were obtained in step two of the analysis. Significance level was set as p = 0.05.
The distribution of different demographic variables in the full sample, the clinical SDQ group and their association with clinical SDQ
OR (95% CI)
Age (mean, range)
Not living with both parents
Vocational level of education (missing 148)
Urbanization (missing 1491)
• Less than 1000 (ref.)
• 1000 - 1499
• 1500 - 2499
• 2500 or more
Analysis of potential confounders yielded a subgroup of variables which were added to the logistic models. (We selected only those confounders that were correlated with delayed school progression and SDQ and altered the association between delayed school progression and SDQ). These covariates were mainly adverse life events: sexual abuse, domestic violence and parental problems with alcohol or addiction. Other confounders were perceived problems with money or income and irregular breakfast. Since many control variables were related to age, gender and ethnicity, these factors were also included in the prediction model.
Prediction models showing delayed school progression as a predictor for mental health problems
Adjusted model confounders
Odds ratio (95% CI)
Odds ratio (95% CI)
Delayed school progression
1.83 (1.27 - 2.63)*
Adverse life events:
Molestation by parents
Violence between parents
Parental problems with alcohol/addiction
In this cross-sectional study we investigated the association between scholastic achievement and current mental health problems in adolescents. We demonstrated that delayed school progression, used as a proxy for poor school achievement, was associated with adolescent mental health problems. After adjusting for potential confounding factors the association was no longer significant. These findings indicate a possible role for delayed school progression as a risk marker for mental health problems at adolescence, but did not provide evidence that delayed school progression is a causal risk factor for mental health problems. However this does not rule out the possibility that school performance may be associated with specific psychiatric outcomes such as schizophrenia.
The factors that we identified as confounders are important to consider in further studies.
Strengths and limitations
The main strengths of this study were the large population-based sample with adolescents of both genders and the richness of the data, particularly on potential confounders. Furthermore, a delay in school progression is an objective measure and not subject to recall bias. The response rate was generally good. Moreover, the association between delayed school progression and mental health problems might have been stronger when non-responders would have joined the study since truants or frequently ill students are probably more likely to have high SDQ scores and problems with scholastic achievement.
This study also has limitations. Delay in school progression was a rather crude proxy for poor school performance and children with delayed school progression probably constituted a heterogeneous group, since the delay could have been the result of enrolling in primary school at a relatively old age or language problems. We reduced this problem considerably by adjusting for covariates, such as ethnicity, and by picking a stringent cut-off point for delayed school progression to include only children with a definite history of scholastic underperformance. Another limitation was the self-reported SDQ as an outcome measure. Although validated and used widely as a measure for mental health problems, complementary information from teachers and parents would improve the sensitivity and specificity. Furthermore, the prevalence of mental health problems in our study population was low compared with international studies using the SDQ . Dutch children have a tendency to score lower on the SDQ than UK children; about 6% of all Dutch children score above the UK cut-off point  and in our sample 4.5% of the participants scored in the clinical range. Additionally, the included children were aged between 10 and 19 years old (99% between 12 and 18 years) and mental health problems may differ between the younger and older participants. This study was also limited by its cross-sectional design. Delay in school progression and mental health problems were measured at the same moment, thus we cannot rule out that mental health problems could have preceded the delay in school progression earlier in youth. However, previous prospective studies on educational performance showed that poor educational attainment often predicts development of psychiatric disorders -.
Interpretation of findings
Contrary to most previous studies addressing poor educational achievement and psychiatric problems, we found no association after adjusting for confounders. This finding is in contrast to previous studies which have shown associations between poor school performance and later psychosis. It is possible that the adolescent age is too early to detect the effects of neurobiological changes on mental health. Furthermore, we focused on general mental health problems, instead of the development of specific (mainly psychotic) disorders in the majority of previous studies.
In addition, poor school achievement can be seen as an event that might mediate the impact of other risk factors for mental health problems. Thus, poor school achievement might function as a trigger for alterations in the causal pathway of genetic and environmental factors underlying neurobiological changes leading to mental disorders.
Lastly, most studies used other measures of poor school performance, like school level , literacy skills  and school grades ,. These measures may be more related to intellectual functioning than a delay in school progression because the latter is more affected by other aspects such as social and emotional development during school-age. Thus, further research is needed to examine the potential role of school performance as an intermediate factor for different risk factors of mental health problems and longitudinal effects of poor school performance.
Overall our results showed that delayed school progression is a risk marker of mental health problems in school aged children, but that this association is largely explained by confounding. This is consistent with the view that poor school performance is a risk indicator for particular psychiatric disorders but not for general mental health problems in adolescents.
We are grateful to the employees of the Municipal Health Service Central Netherlands for collection of the data.
- Merikangas KR, Nakamura EF, Kessler RC: Epidemiology of mental disorders in children and adolescents. Dialogues Clin Neurosci. 2009, 11: 7-20.PubMedPubMed CentralGoogle Scholar
- Crone MR, Vogels AG, Hoekstra F, Treffers PD, Reijneveld SA: A comparison of four scoring methods based on the parent-rated Strengths and Difficulties Questionnaire as used in the Dutch preventive child health care system. BMC Public Health. 2008, 8: 106-10.1186/1471-2458-8-106.View ArticlePubMedPubMed CentralGoogle Scholar
- Hofstra MB, Van der Ende J, Verhulst FC: Continuity and change of psychopathology from childhood into adulthood: a 14-year follow-up study. J Am Acad Child Adolesc Psychiatry. 2000, 39: 850-858. 10.1097/00004583-200007000-00013.View ArticlePubMedGoogle Scholar
- Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustun TB: Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007, 20: 359-364. 10.1097/YCO.0b013e32816ebc8c.View ArticlePubMedPubMed CentralGoogle Scholar
- MacCabe JH: Population-based cohort studies on premorbid cognitive function in schizophrenia. Epidemiol Rev. 2008, 30: 77-83. 10.1093/epirev/mxn007.View ArticlePubMedGoogle Scholar
- Zammit S, Allebeck P, David AS, Dalman C, Hemmingsson T, Lundberg I, Lewis G: A longitudinal study of premorbid IQ Score and risk of developing schizophrenia, bipolar disorder, severe depression, and other nonaffective psychoses. Arch Gen Psychiatry. 2004, 61: 354-360. 10.1001/archpsyc.61.4.354.View ArticlePubMedGoogle Scholar
- Koenen KC, Moffitt TE, Roberts AL, Martin LT, Kubzansky L, Harrington H, Poulton R, Caspi A: Childhood IQ and adult mental disorders: a test of the cognitive reserve hypothesis. Am J Psychiatry. 2009, 166: 50-57. 10.1176/appi.ajp.2008.08030343.View ArticlePubMedGoogle Scholar
- Batty GD, Mortensen EL, Osler M: Childhood IQ in relation to later psychiatric disorder: evidence from a Danish birth cohort study. Br J Psychiatry. 2005, 187: 180-181. 10.1192/bjp.187.2.180.View ArticlePubMedGoogle Scholar
- Walker NP, McConville PM, Hunter D, Deary IJ, Whalley LJ: Childhood mental ability and lifetime psychiatric contact: A 66-year follow-up study of the 1932 Scottish Mental Ability Survey. Intelligence. 2002, 30: 233-245. 10.1016/S0160-2896(01)00098-8.View ArticleGoogle Scholar
- Reichenberg A, Weiser M, Rabinowitz J, Caspi A, Schmeidler J, Mark M, Kaplan Z, Davidson M: A population-based cohort study of premorbid intellectual, language, and behavioral functioning in patients with schizophrenia, schizoaffective disorder, and nonpsychotic bipolar disorder. Am J Psychiatry. 2002, 159: 2027-2035. 10.1176/appi.ajp.159.12.2027.View ArticlePubMedGoogle Scholar
- Lawrie SM, Olabi B, Hall J, McIntosh AM: Do we have any solid evidence of clinical utility about the pathophysiology of schizophrenia?. World Psychiatry. 2011, 10: 19-31.View ArticlePubMedPubMed CentralGoogle Scholar
- Hameed MA, Lewis AJ, Sullivan S, Zammit S: Child literacy and psychotic experiences in early adolescence: findings from the ALSPAC study. Schizophr Res. 2013, 145 (1–3): 88-94. 10.1016/j.schres.2012.12.025.View ArticlePubMedGoogle Scholar
- Chong SA, Subramaniam M, Lee IM, Pek E, Cheok C, Verma S, Wong J: Academic attainment: a predictor of psychiatric disorders?. Soc Psychiatry Psychiatr Epidemiol. 2009, 44: 999-1004. 10.1007/s00127-009-0027-3.View ArticlePubMedGoogle Scholar
- MacCabe JH, Lambe MP, Cnattingius S, Torrang A, Bjork C, Sham PC, David AS, Murray RM, Hultman CM: Scholastic achievement at age 16 and risk of schizophrenia and other psychoses: a national cohort study. Psychol Med. 2008, 38: 1133-1140. 10.1017/S0033291707002048.View ArticlePubMedGoogle Scholar
- Isohanni I, Jarvelin MR, Nieminen P, Jones P, Rantakallio P, Jokelainen J, Isohanni M: School performance as a predictor of psychiatric hospitalization in adult life. A 28-year follow-up in the Northern Finland 1966 Birth Cohort. Psychol Med. 1998, 28: 967-974. 10.1017/S0033291798006928.View ArticlePubMedGoogle Scholar
- Goodman R, Meltzer H, Bailey V: The strengths and difficulties questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry. 1998, 7: 125-130. 10.1007/s007870050057.View ArticlePubMedGoogle Scholar
- Muris P, Meesters C, van den Berg F: The Strengths and Difficulties Questionnaire (SDQ)–further evidence for its reliability and validity in a community sample of dutch children and adolescents. Eur Child Adolesc Psychiatry. 2003, 12: 1-8. 10.1007/s00787-003-0298-2.View ArticlePubMedGoogle Scholar
- Goodman R, Ford T, Simmons H, Gatward R, Meltzer H: Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000, 177: 534-539. 10.1192/bjp.177.6.534.View ArticlePubMedGoogle Scholar
- Timmermans M, van Lier P, Koot H: Pathways of behavior problems from childhood to late adolescence leading to delinquency and academic underachievement. J Clin Child Adolesc Psychol. 2009, 38: 630-638. 10.1080/15374410903103502.View ArticlePubMedGoogle Scholar
- Korkeila J, Lehtinen V, Bijl R, Dalgard OS, Kovess V, Morgan A, Salize H: Establishing a set of mental health indicators for Europe. Scand J Public Health. 2003, 31: 451-459. 10.1080/14034940210165208.View ArticlePubMedGoogle Scholar
- Peen J, Dekker J: Is urbanicity an environmental risk-factor for psychiatric disorders?. Lancet. 2004, 363: 2012-2013. 10.1016/S0140-6736(04)16486-6.View ArticlePubMedGoogle Scholar
- Rothon C, Head J, Klineberg E, Stansfeld S: Can social support protect bullied adolescents from adverse outcomes? A prospective study on the effects of bullying on the educational achievement and mental health of adolescents at secondary schools in East London. J Adolesc. 2011, 34: 579-588. 10.1016/j.adolescence.2010.02.007.View ArticlePubMedPubMed CentralGoogle Scholar
- Bond L, Butler H, Thomas L, Carlin J, Glover S, Bowes G, Patton G: Social and school connectedness in early secondary school as predictors of late teenage substance use, mental health, and academic outcomes. J Adolesc Health. 2007, 40: 357.9-357.18. 10.1016/j.jadohealth.2006.10.013.View ArticleGoogle Scholar
- Nijs M, Bun C, Tempelaar W, De Wit N, Burger H, Plevier C, Boks M: Perceived school safety is strongly associated with adolescent’s mental health problems. Community Ment Health J. 2014, 50 (2): 127-134. 10.1007/s10597-013-9599-1.View ArticlePubMedGoogle Scholar
- Hibbett A, Fogelman K: Future lives of truants: family formation and health-related behaviour. Br J Educ Psychol. 1990, 60 (Pt 2): 171-179. 10.1111/j.2044-8279.1990.tb00934.x.View ArticlePubMedGoogle Scholar
- Van Gastel WA, Tempelaar W, Bun C, Schubart CD, Kahn RS, Plevier C, Boks M: Cannabis use as an indicator of risk for mental health problems in adolescents: a cross-sectional population-based study at secondary schools. Psychol Med. 2012, 3: 1-8.Google Scholar
- Goodman A: Substance use and common child mental health problems: examining longitudinal associations in a British sample. Addiction. 2010, 105: 1484-96. 10.1111/j.1360-0443.2010.02981.x.View ArticlePubMedGoogle Scholar
- Lien L: Is breakfast consumption related to mental distress and academic performance in adolescents?. Public Health Nutr. 2007, 10: 422-428. 10.1017/S1368980007258550.View ArticlePubMedGoogle Scholar
- Vittinghoff E, Glidden D, Shiboski S, McCulloch CE: Regression methods in biostatistics: linear, logistic, survival and repeated measures models. 2005, Springer, New YorkGoogle Scholar
- Greenland S: Modeling and variable selection in epidemiologic analysis. Am J Public Health. 1989, 79: 340-349. 10.2105/AJPH.79.3.340.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.