- Study protocol
- Open Access
- Open Peer Review
School environment and mental health in early adolescence - a longitudinal study in Sweden (KUPOL)
BMC Psychiatry volume 16, Article number: 243 (2016)
Longitudinal studies indicate strong associations between school proficiency and indicators of mental health throughout adulthood, but the mechanisms of such associations are not fully elucidated. The Kupol study is a prospective cohort study in Sweden set up in order to: (i) describe the association of school pedagogic and social environment and its specific dimensions with the risk of mental ill-health and psychiatric disorders in adolescence; (ii) evaluate the direct effects of school pedagogic and social environment on mental health and the effects mediated by the individual’s academic achievements; and (iii) assess if school pedagogic and social environment are associated with mental ill-health through epigenetic mechanisms, in particular those involving genes regulating the response to stress.
The Kupol cohort at baseline consists of 3959 children attending the 7th grade of compulsory school (13–14 years old) in 8 regions of central Sweden in the school years 2013–2014 or 2014–2015. Three follow-up surveys in subsequent years are planned. Teachers’ and students’ perceptions of the culture, climate and ethos of their schools, and students’ mental ill-health are assessed at the whole school level by annual questionnaire surveys. In order to conduct epigenetic analyses saliva specimens are collected from a nested sample of students at inception and two years later. Further, class-, family- and child-level information is collected at baseline and during each year of follow-up. Self-reported information is being complemented with register data via record-linkages to national and regional health and administrative registers.
The topic being investigated is new, and the sample constitutes the largest adolescent cohort in Sweden involved in an ad hoc study. Epigenetic analyses centered on environmental cues to stress response are a thoroughly new approach. Finally a notable feature is the multi-informant and multi-method data collection, with surveys at the school, class, family, and student level. Collaboration and data access: interested investigators should contact the coordinating centre. Additional information is available on the study’s website, http://kupolstudien.se/.
In Sweden, self-reported mental health problems and demand for psychiatric care among adolescents has increased in the last decades, and this is especially true for girls [1, 2]. Moreover, suicide rates have decreased in Sweden with the exception of the 10–24 age group, and suicide attempts have actually increased among girls in this age group .
Alongside the aforementioned trends in mental health problems, a gradual decrease in the literacy level of Swedish students has been noted for several years. According to the Programme for International Student Assessment (PISA), the ranking of Swedish students in the final year of compulsory school has been decreasing in all four assessments conducted between 2000 and 2010 .
Longitudinal studies indicate strong associations between school proficiency and indicators of mental health throughout adulthood, but the mechanisms of such associations are not fully elucidated [4–6]. In addition, the influence of school pedagogic and social environment as such on adolescents’ mental health is insufficiently investigated, particularly in Sweden. Because of the multiple pathways involved, a singular focus is sometimes placed on what children bring with them when they enter schools (eg., children’s social background) rather than on school environment or the complex interaction between multiple influences.
The Kupol study (Swedish acronym for “Knowledge on young people’s mental health and learning”) is a prospective cohort study in Sweden set up in order to investigate changes in adolescent’s mental health in relation to changes in school-level factors.
Specifically, the study aims to: (a) describe the association of school pedagogic and social environment and their specific dimensions (e.g. pedagogic leadership, teaching methods, relations in school) with the risk of mental ill-health and psychiatric disorders in adolescence; (b) evaluate the direct effects of school pedagogic and social environment on mental health and the effects mediated by the individual’s academic achievements; and (c) assess if school pedagogic and social environment are associated with mental ill-health through epigenetic mechanisms, in particular those involving genes regulating the response to stress.
Because of the extensive information accrued (described in detail below), the Kupol study allows for the exploration of highly relevant areas in addition to its primary objectives, such as: feasibility and effectiveness of screening for early detection of mental health problems among adolescents, costs of mental illness among school children, interaction between school and family-level psycho-social factors and mental ill-health, access to health-care interventions for sub-clinical mental health problems.
Participants and recruitment of study population
The target for the cohort recruitment was constituted by children attending the 7th grade of compulsory school in both urban and rural areas of 8 regions of southern and central Sweden: Gävleborg, Jönköping, Stockholm, Södermanland, Uppsala, Värmland, Västmanland, and Örebro. The recruitment took place during the school years 2013–2014 and 2014–2015. In total, the target population in these regions was estimated to be of approximately 44000 students in each school year, representing about 44 % of the Swedish population in this age group.
The recruitment of schools in the Kupol study started during the spring semester of 2013. To be eligible, schools had to register at least 20 students per grade in the upper block (grade 7 to 9). In all, 541 schools were contacted, of which 6 were not eligible. Of the eligible schools, 101 (19 %) were willing to participate in the study while 434 (81 %) declined study participation. Figure 1 shows a map of the schools’ locations.
Parents and students
All students registered in the 7th grade in the two school years mentioned above were potentially eligible. Exclusion criteria included severe learning disabilities and/or poor comprehension of the Swedish language.
An invitation to participate, including contact information to the project team, was forwarded by the school using the usual channels for school-family communication. The students also received a shortened version of the same information directly in schools. The initial contact was followed by mail delivery of written material with a complete description of the aim of the study, data collection methods and an explanation of the intended use of the collected data. A consent form and parent questionnaire was also sent to the adolescents’ guardians at the address of the legal residence where the adolescents were registered. Upon request, all material was made available into 10 different languages. Written informed consent to the child’s participation was required from parents/guardians, separately for the three components of data collection (survey, record linkage with registers, saliva sampling and epigenetic analyses). A flow-chart of the participants’ recruitment is displayed in Fig. 2.
In Table 1, participating and non-participating schools are compared regarding selected characteristics of the organization and of the student population. Notable differences concerned the authority responsible for running the school (participation among municipality schools was about half that among private school), and the average proportion of students with foreign born parents which was higher in the non-participating schools (25.5 %) than in the participating schools (19.4 %). Schools with a high proportion of teachers with a University degree were more represented among non-participating schools, but the mean difference was modest.
In Table 2, the odds ratios of school participation are presented separately for privately and publically run schools according to selected school characteristics. Increasing numbers of students in each grade predicted lower participation among private schools, while increasing proportion of students born outside Sweden or with non-Swedish parents was associated with lower school participation in both privately and publically run schools.
A total of 3959 school children agreed to participate, of which 3671 (48.2 % boys) provided response to baseline (92.7 %). Table 3 reports the socio-demographic characteristics of the children’s families. The large majority of participants lived in families with highly educated parents, with at least one parent employed and/or born in Sweden.
In total, three follow-up surveys in subsequent years are planned for each sub-sample in the cohort (i.e. children recruited in the school years 2013–2014 or 2014–2015). Two of the surveys are conducted while the children are still in the compulsory school, while the third one will be conducted during the years of the transition to upper secondary school or equivalent (2017–2019). Figure 3 shows the timeline for data collection.
To date, baseline data have been collected for the whole cohort, while follow-up data have been collected for the sub-cohort recruited in 2013–2014 (proportion retained 97.7 %). Multi-informant and multi-method data collection is employed, with surveys at the school, classroom, family, and student level, using both paper and web-based instruments. Self-reported information is complemented with register data via record-linkages to national and regional health and administrative registers (Table 5).
Table 5 provides a detailed description of the information collected in the study. The paragraph below provides an overview of the main information and of data collection procedures among school personnel, participating students and their parents.
School pedagogic and social climate
Teacher and student perceptions of the culture, climate and ethos of their schools are assessed using the PESOC scale (Pedagogical and Social Climate of a school, http://gauss.stat.su.se/rr/RR2004_6.pdf), an instrument available as a teacher or student version. The instrument for teachers consists of a self-completed questionnaire containing 67 items, while the corresponding instrument for students contains 53 items. In each school, the instrument is administered to all teaching personnel and to all students attending the 9th grade, i.e. the last compulsory school year.
Respondents are asked to rate their level of agreement with the statements on a 4 point-Likert scale ranging from “not at all” to “completely agree”. A fifth option for “don’t know” is also included. Resting on theoretical principles, the statements are grouped to form subscales assessing different domains (e.g. for students “perceived school expectations” or “perceptions of teachers’ support”; for teachers “pedagogic leadership of the principal” or “cooperation among teachers”). There are eight such domains in the student instrument and eleven in the teacher instrument. A comprehensive psychometric analysis of the PESOC instruments is under publication [7, 8].
Strengths and Difficulties Questionnaire and Center for Epidemiologic Studies Depression Scale for Children
Mental ill-health is primarily assessed by means of multi-informant (parent, child) completion of the 25-item Strengths and Difficulties Questionnaire (SDQ). The SDQ evaluates five domains: hyperactivity-inattention, emotional symptoms, conduct problems, peer problems and prosocial behaviour . The SDQ is included in the parents’ and children’s questionnaire at baseline and each subsequent follow-up. In order to increase the sensitivity of the mental ill-health assessment in the domain of internalizing problems, the Center for Epidemiologic Studies Depression Scale for Children (CES-DC), a 20-item scale is also included in the adolescent questionnaire .
Indicators of general and mental health among participant children at baseline are shown in Table 4, separately by gender.
At baseline, most children reported good or very good general health, with only 2.5 % reporting poor health. Scale scores indicating mental health problems were found among 5 % of the participants using the child SDQ and among 9.6 % using the CES-DC. Consistent differences in self-reported health were observed between genders, with girls reporting very good general health to a lesser extent than boys (54.5 % vs 65.8 %). Scale scores indicating mental health problems were also more frequent among girls, in both SDQ and CES-DC. Such differences between genders were not present in parent-reported SDQ, despite the overall estimate of the prevalence of children with high scores (4.6 %) was close to the children-based assessment. In other words, average parents’ rating seemed to overestimate the frequency of boys’ mental health problems compared to the children’s self-ratings, while the opposite was true for girls.
Biological samples and study of epigenetics
Saliva samples are collected from a nested random sample of about 1500 consenting students at baseline (7th grade) and again at the end of the 9th grade. On each occasion, three saliva samples are collected from each participant, two of which will be used to determine morning and afternoon cortisol levels, while the third sample will be used for genetic and epigenetic analyses, in particular the methylation of deoxyribonucleic acid (DNA) in regulatory regions associated to mental ill-health and/or to childhood/adolescence adversities. Such epigenetic modifications have particular importance because they can influence the developing person through-out the lifespan, providing evidence that environmental stress can be cemented in the genome through DNA methylation . All samples are stored in the Karolinska University Hospital Biobank.
Other socio-demographic and psycho-social factors
In order to have insight into potential confounding factors, as well as to study mediatory and interaction effects, further information about class, family, and child characteristics has been collected at baseline and at follow-up.
Items at the classroom-level are included in a teacher questionnaire, asking about classroom composition, formal competence of the teachers in the core subjects, curricular activities for each core subject, cross-disciplinary, special pedagogic activities, social climate in the classroom, i.e. perception of discipline/absenteeism, the quality of relations among students, between students and teachers, and among teachers.
The parental questionnaire includes items on composition of the family and the index child’s cohabitation forms, parental employment, attitudes and expectations towards school achievements, bonding within family, and own use of alcohol and tobacco.
The child questionnaire includes items on bonding to parents and peers, lifetime and recent use of tobacco, alcohol and illicit drugs, height and weight, self-rated health, and relation to school.
In order to refine the assessment of mental health outcomes, information on clinical diagnoses will be accrued through record-linkages with national or regional health registers, such as the Hospital Discharge Register, the Swedish Prescribed Drug Register, and the child neuropsychiatric outpatient clinics (BUP) (Table 5). Other information accrued from health or administrative registers include school absenteeism (school computerized records) and school grades (The Swedish National Agency of Education); socio-economic factors such as parental income and parental sickness and disability benefit (The Longitudinal Integration Database for Health Insurance and Labour Market Studies, LISA). Table 5 gives an overview of these record-linkages, which are deterministic because they are based on a unique individual identifier (personal registration number, PNR) assigned to all residents in Sweden at birth or at the time of entering the country.
Sample size and statistical power
The accrued sample will provide more than 80 % power to detect as statistically significant (alpha = 0.05) a 50 % increase in the risk of mental health problems among students exposed to the lowest quartile of PESOC score compared to the higher quartiles assuming a cumulative incidence among the unexposed as low as 8 %, taking into account the cluster design.
Because the accrued data will have an inherent hierarchical structure, with students grouped in classes and schools, multilevel regression modeling will be the elective analytical method. Both the primary outcome (SDQ-based mental health problems) and most secondary outcomes (e.g. substance abuse, conduct disorders, internalizing symptoms) will be primarily categorized as dichotomous. Therefore, we will use logistic regression to model yearly and cumulative incidence. The primary exposure (PESOC) will be analyzed as a continuous as well as a categorical variable. In the main analysis we will explore the mediatory and effect-modifying role of school proficiency, other individual-level factors (above all, gender) and out-of-school factors (e.g. family circumstances) on the association between overall school pedagogic climate, its sub-dimensions and occurrence of mental disorders. Potential confounders to be adjusted for mainly consist of familial social circumstances such as migration status and social adversity, which may indeed impact on choice of school as well as mental health. Given the complex interplay of causal and non-causal relations occurring between different levels of environmental and individual factors the primary analyses will be complemented with alternative estimation and testing techniques, such as structural equation modeling.
Finally, conditional logistic regression will be used to analyze the case-control study of DNA methylation and cortisol levels.
The main strengths of the Kupol study include its longitudinal design, with yearly data collection during and beyond upper primary school, and the wide range of information available on different levels, using multi-informant and multi-method assessments. A rich data set is being compiled through the use of registers, surveys at the school, classroom, student and parent level, as well as through collection of biological samples.
The low baseline response rate at the school (19 %) and student (29 %) levels may have contributed to greater than intended inclusion of high socio-economic status participants. The total sample at inception of 3959 adolescents makes this the largest ad hoc cohort of adolescents in Sweden, i.e. with collection of original data. Further, the follow-up rate was very good. There was a high retention rate (97.7 %) from baseline to the first follow-up for the earliest included sample. In terms of expertise, the Kupol study brings together newly-trained and well-established researchers across a wide range of disciplines (medicine, epidemiology, social sciences, education, and psychology) who share an interest in young people’s mental health. In summary, the Kupol study cohort provides a unique platform to evaluate the association between different dimensions of school level factors and mental health among adolescents.
Interested investigators should contact the corresponding author at the coordinating centre. More information can be found on the study’s website, http://kupolstudien.se/.
CES-DC, Center for Epidemiologic Studies Depression Scale for Children; DNA, Deoxyribonucleic Acid; LISA, Longitudinal Integration Database for Health Insurance and Labour Market Studies; PESOC, Pedagogical and Social Climate of a school; PISA, Programme for International Student Assessment; PNR, Personal Registration Number; SDQ, Strengths and Difficulties Questionnaire
Folkhälsomyndigheten. Folkhälsan i Sverige årsrapport 2014. Sweden: 2014
Sciences TRSAo. Trends in Child and AdolescentMental Health in Sweden2010. Available from: http://www.buph.se/download/18.215ade6b1325af7d93380003585/1366677798136/RSAS_Healthcommitee_Statement_Trends_lowresolution.pdf. Accessed 4 July 2016.
OECD. Improving Schools in Sweden: An OECD Perspective. Organisation for Economic Cooperation and Development 2015. Available from: http://www.oecd.org/edu/school/Improving-Schools-in-Sweden.pdf. Accessed 4 July 2016.
Kosidou KDC, Fredlund P, Leea BK, Galantia R, Isacssona G, Magnussona C. School performance and the risk of suicide attempts in young adults: a longitudinal population-based study. Psychological Medicine. 2014;44(6):1235–43.
Chong SASM, Lee IM, Pek E, Cheok C, Verma S, Wong J. Academic attainment: a predictor of psychiatric disorders? Social Psychiatry and Psychiatric Epidemiology. 2009;44:999–1004.
Verboom CE, Sijtsema JJ, Verhulst FC, Penninx BW, Ormel J. Longitudinal associations between depressive problems, academic performance, and social functioning in adolescent boys and girls. Developmental Psychology. 2014;50(1):245–57.
Hultin H, Ferrer-Wreder L, Dimitrova R, Karlberg M, Galanti MR. Psychometric Properties of an Instrument to measure Social and Pedagogical School Climate among Teachers (PESOC). (Accepted, Scandinavian Journal of Educational Research)
Hultin H, Ferrer-Wreder L, Dimitrova R, Karlberg M, Galanti MR.Pedagogical and Social School Climate: Psychometric Evaluation and Validation of the Student Edition of PESOC. (Manuscript submitted )
Goodman R, Ford T, Simmons H, Gatward R, Meltzer H. Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disordersin a community sample. British Journal of Psychiatry. 2000;177:534–9.
Fendrich M, Weissman MM, Warner V. Screening for depressive disorder in children and adolescents: validating the Center for Epidemiologic Studies Depression Scale for Children. Am J Epidemiol. 1990;131(3):538–51.
McGowan PO, Szyf M. The epigenetics of social adversity in early life: implications for mental health outcomes. Neurobiology of disease. 2010;39(1):66–72.
We thank all participating students and parents as well as the teachers, and the administrative and healthcare staff of the participating school. We wish to acknowledge the hard and relentless work of the Kupol study’s operative staff, in particular the field coordinator Elin Arnö, the administrator Jon Edlund, and the research assistants Fanny Engman and Johanna Lindman without whom the study would have never been possible.
The Kupol study is financially supported by a unique grant (nr 259-2012-48) which includes funds from the Swedish Research Council Formas, The Swedish Research Council for Health, Working Life and Welfare, and The Swedish Research Council-Vetenskapsrådet.
Availability of data and material
For ethical and legal restriction we can’t upload a minimal data set. The data are available upon request, the interested researchers could contact Prof Maria Rosaria Galanti (firstname.lastname@example.org).
MRG is the principal investigator of the Kupol study, who has conceived and initially designed the study. MRG, HH, CD, KE, LFW, YF, MK, CL, CM and KS provided expertise in the design of the study as well as in the choice of the instruments to assess adolescents’ metal health and other constructs. JZ conducted the data analysis under supervision of MRG. ER and MA drafted the article under supervision of MRG. All authors contributed to the description of the methods, the interpretation of the results, read and approved the final manuscript.
All authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Written informed consent to the child’s participation was required from parents/guardians, separately for the three components of data collection (survey, record linkage with registers, saliva sampling and epigenetic analyses). The study was approved by the Stockholm Ethics Review Board (reference number:2012/1904-31/01).