- Research article
- Open Access
- Open Peer Review
Validity and reliability of the kiddie schedule for affective disorders and schizophrenia present and lifetime version DSM-5 (K-SADS-PL-5) Spanish version
BMC Psychiatryvolume 18, Article number: 193 (2018)
There are various language adaptations of the Schedule for Affective Disorders and Schizophrenia for School Age Children Present and Lifetime Version (K-SADS-PL). In order to comply with the changes in DSM classification, the Spanish edition of the interview was in need of update and evaluation.
K-SADS-PL was adapted to correspond to DSM-5 categories. All clinicians received training, and a 90% agreement was reached. Patients and their parents or guardians were interviewed and videotaped, and the videos were exchanged between raters. Factor analysis was performed and inter-rater reliability was calculated only in the case of diagnoses in which there were more than five patients.
A total of 74 subjects were included. The Factor Analysis yielded six factors (Depressive, Stress Hyperarousal, Disruptive Behavioral, Irritable Explosive, Obsessive Repetitive and Encopresis), representing 72% of the variance. Kappa values for inter-rater agreement were larger than 0.7 for over half of the disorders.
The factor structure of diagnoses, made with the instrument was found to correspond to the DSM-5 disorder organization. The instrument showed good construct validity and inter-rater reliability, which makes it a useful tool for clinical research studies in children and adolescents.
Diagnostic clinical interviews are essential for child and adolescent psychiatric research, since they homogenize criteria and decrease sources of variability. The most commonly used semi-structured clinical interview is the Kiddie Schedule for Affective Disorders and Schizophrenia, Present and Lifetime version (K-SADS-PL) which is designed to correspond to the Diagnostic and Statistical Manual for Mental Disorders fourth edition (DSM-IV) .
There are several validity and reliability studies of different language adaptations of the K- SADS-PL. The original version was examined for its inter-rater, test-retest reliability and concurrent validity . The Spanish version reported inter-rater reliability . The Korean version reported inter-rater, test-retest reliability, consensus validity, and established its correlation with the Child Behavioral Check List (CBCL) . The Icelandic version determined convergent and divergent validity in relation to the diagnosis of depression . For the Iranian (Farsi) version, one study determined the validity by consensus as well as inter-rater and test-retest reliability , while a second study added concurrent validity of the instrument . The Brazilian-Portuguese version determined the convergent validity with the CBCL . Regarding the interview adaptations based on DSM-5 criteria, the Taiwanese team reported inter-rater reliability for the Mandarin K-SADS epidemiological version  while in a recent study, the Kenyan team found good test-retest reliability for the ADHD module of the K-SADS-PL .
Since the K-SADS-PL was designed to correspond to the DSM-IV, the instrument requires updating in order to include the new DSM-5  categories. The organization of the categories was modified to include neurodevelopmental disorders. In addition, new diagnoses have been added and others have been modified. In particular, disruptive mood dysregulation disorder (DMDD), avoidant restrictive food intake disorder (ARFID) and binge eating disorder (BID) are new in DSM-5, while autism spectrum disorder (ASD), intermittent explosive disorder (IED) and social anxiety disorder (SAD) represent modified versions of diagnoses that were already in the DSM-IV. Clinical conditions not considered categories, such as non suicidal self injury (NSSI) and limited prosocial emotions (LPE) were also included. Since these changes may have modified the internal structure of the interview, a factor analysis of the K-SADS-PL-5 could help to determine how the diagnostic groups are integrated in the schedule.
A factor analysis allows us to construct a dimensional view of the diagnoses and permits a better understanding of the taxonomic commonalities and clinical comorbidities [12, 13]. Other validation methods such as convergent or divergent validity have failed to consider the possibility that “disorders might merge into one another with no natural boundary in between” . Factor analysis of epidemiological data from structured clinical interviews has helped to identify factors explaining diagnostic groupings. Main factors have been termed as internalizing and externalizing: the former includes diagnoses of anxiety and depression, while the latter includes disruptive behaviors and substance use disorders [15, 16]. Recently, a study using a large, epidemiological sample of adolescents, has further divided these two factors into four: distress disorders, fear disorders, behavioral disorders, and substance disorders. The first two grouped within the internalizing factor, while the last two clustered within the externalizing factor . Seeking further definition, the authors explored a fifth factor, which applied only to eating disorders . It is worth noting that most studies use epidemiological samples and therefore studies in clinical settings could help to understand diagnostic grouping in such scenarios.
Inter-rater agreement is among the most important procedures for establishing reliability in regard to psychiatric interviews . Several studies from different continents have included inter-rater reliability for the KSADS-PL [2,3,4, 6, 9]. In general, these studies suggest that inter-rater reliability in pediatric population are often larger for externalizing disorders than for internalizing disorders.
The objective of this study was to determine the construct validity and the inter-rater reliability of the K-SADS-PL-5 in an international multicenter study.
The present research was approved by “Comite de Ética en investigación del Instituto Nacional de Psiquiatría Ramón de la Fuente Múñiz” (CEI/C/003/2014) to be conducted in all sites. Written informed assent and consent were obtained from the parent or guardian and the child or adolescent.
The sample was comprised of children and adolescents (6 to 18 years old) who were referred to medical-psychiatric evaluation in any of the clinical sites. The parent or guardian and the child or adolescent were interviewed and videotaped for one to four sessions, each lasting 30 to 120 min.
The sample was obtained from inpatient and outpatient services in four different Latin American countries. Four sites were located in Mexico (MX), three in Mexico City (MX1, MX2 and MX3) and one in Aguascalientes (MX4). The other three were located in South America, one in Medellin, Colombia (CO), another in Santiago de Chile, Chile (CL), and the last one in Montevideo, Uruguay (UR). Venezuela and Argentina only participated in the inter-rater evaluation.
Description of the instrument
The K-SADS-PL-5 is a semi-structured diagnostic interview designed to collect information from the child or adolescent as well as their parents or other informants. A trained interviewer produces a better clinical estimate or summary for each symptom of all categories included. With this interview, it is possible to determine current episodes (defined as episodes that have occurred within the last six months) or past episodes. The current study used only information regarding current episodes. The K-SADS-PL-5 consists of a screening section and six supplements. Screening contains an introductory interview that covers the reason for consultation and general patient data as well as a screening section of the primary symptoms of each disorder. When at least one symptom is evaluated as definitive in the summary, the evaluation of the disorder is completed in the corresponding supplement. In this version, the six new or modified diagnoses, NSSI and LPE were included to be completed in the screening. The General Assessment Function Scale (GAF) and the World Health Organization Disability Assessment Scale (WHODAS) were also integrated into screening in order to harmonize with DSM-5. Supplement 1 includes depressive and bipolar disorders, supplement 2 includes psychotic disorders, supplement 3 includes anxiety, stress and obsessive compulsive disorders, supplement 4 includes disruptive behavior and impulse control disorders, supplement 5 includes substance use disorders and feeding and eating disorders, and the new supplement 6 includes neurodevelopmental disorders.
The first stage, carried out from January 2014 to June 2015 included the following steps, (i) a Latin American international clinical team comprising the current authors reviewed and adapted the K-SADS-PL Spanish version  to the DSM-5 structure followed by (ii) the inclusion of the six new or modified diagnoses under consensus and (iii) the text review and testing with clinicians, patients and parents in order to obtain a final version incorporating all comments and suggestions. The second stage, carried out from August 2015 to January 2016, consisted of 20 h workshops to train interviewers. A consensus criteria of > 90% match between trainer and trainees’ diagnoses was reached, as done in previous studies [9, 19]. Workshops were held in Buenos Aires, Medellin, and Mexico City. During the third stage, carried out from February to July 2016, clinicians from each site sought to interview 10 subjects (five children and five adolescents); if this quota was not met, the number of patients was compensated by sites with greater capacity. This number of patients was chosen a priori in order to balance the number of children and adolescents from each site. In every case, informed assent and consent was obtained previous to the interviews. Each of the sites was coordinated by a child psychiatrist with more than fifteen years of clinical experience. The rest of the raters were child psychiatrists and clinical psychologists. Each site coordinator maintained supervision of the interviews and communication with the principal investigator with whom any doubt was resolved. The fourth stage, carried out from August 2016 to February 2017, consisted in the inter-site exchange and rating of the videotaped interviews, which was done every three weeks through a privately shared video system over the internet. The principal investigator randomly assigned every rated interview to at least two raters. Every rater evaluated the interview using the K-SADS-PL-5 and sent back the results to the principal investigator. This resulted in three separate evaluations for each interview.
The general demographic and diagnostic data of the subjects was described using percentages, medians and interquartile ranges. For the factor analysis, a polychoric correlation was performed on a dichotomous matrix of diagnoses obtained from the summary section of the K-SADS-PL-5 (classified as either present or absent) discarding those that were completely absent or had low prevalence (tic disorder, cyclothymia, bipolar disorder, enuresis, anorexia disorder, bulimia disorder, avoidant restrictive food intake disorder, tobacco use disorder, substance use disorder schizophrenia). Using a Cattell’s scree test, the resulting number of factors and the corresponding values were plotted. With this criteria, we settled on six factors and proceeded to perform a factor analysis using the generalized least squares method with an oblimin rotation, as recommended by Stuart . We established minimal factorial load for values > 0.40 and focused on the maximum loading per factor. Cattell’s scree test was performed using the scree function, the polychoric correlation was performed using the cor.ci function and the factor analysis was performed using the fa function; all functions belong to the psych package . For inter-rater reliability, Cohen’s Kappa tests were calculated for diagnoses with 5 or more subjects . All analyses were performed in R .
Eighty children and adolescents from all venues were evaluated; six were excluded because they did not have complete screening or supplements. Results are shown for 74 subjects. Mexico contributed with 50 from four sites: MX1 = 30, MX2 = 10, MX3 = 8 and MX4 = 2; South America contributed 24 from three sites: CO = 15, CL = 5 and UR = 4. The sample were 59% males, 62.1% children, the median age and interquartile range (IQR) was 11 (9–14) years. They presented a median number of comorbid diagnoses per patient of 3 (1–5.75). Complete demographic and diagnostic clinical characteristics of the sample can be reviewed in a previous report .
The Factor Analysis of the interview revealed six factors that explained 72% of the total variance. In addition, a five (64% of variance explained) and a seven (75% of variance explained) factor models were performed. We found that three factors, Depressive Factor (DF), Disruptive Behavior Factor (DBF) and an Irritable Explosive Factor (IEF) had high stability and were present in all solutions. The other three in the six factor solution were Stress Hyperarousal (SHF), Obsessive Repetitive (ORF) and Encopresis Factors (EnF). The eigenvalues for each factor and the factor load for the six factor solution are shown in Table 1. The five and seven factor solutions can be seen in the Additional file 1: Tables S1 and S2.
The Kappa correlation coefficients were established for 11 categories, NSSI and, LPE. The agreement between the disruptive behavior disorders was greater than that of anxiety and depressive disorders. Details are shown in Table 2.
The main goal of current study was to establish construct validity and inter-rater reliability for the Spanish version of K-SADS-PL-5. A factor analysis revealed six groups of interest and reliability analysis showed Kappa values > 0.7 in the majority of the diagnostic categories.
We obtained a factor solution suggesting robust diagnostic groupings. Below, we discuss each factor independently.
The DF included major depressive disorder (MDD), NSSI, selective mutism (SM), DMDD and dysthimic disorder. Even though NSSI is not a mood disorder per se, it is a phenomenon frequently related to affective disorders [25, 26]. DMDD is a new disorder in the affective disorders chapter, and it has been shown in follow up studies to be associated with depression and anxiety . The inclusion of SM in this factor could reflect its frequent comorbidity with depressive disorders .
The SHF included SAD, BED, post traumatic stress disorder (PTSD), panic disorder (PD) and specific phobia (SPH). Hyperarousal in social situations is a physiological characteristic that has been shown as a risk factor for later childhood symptoms of social anxiety and it has been proposed as a biological mechanism in the intergenerational transmission of SAD . The relationship between anxiety disorders and BED has been demonstrated in adolescent clinical samples . Previous evidence mentions stressful life events in early childhood as predictors of PD and SPH  and to be associated with BED ; a history of symptoms of PTSD also predict the later onset of binges . Essentially, the evidence shows that stress life events may represent the main axis of the SHF.
The DBF included attention deficit hyperactivity disorder (ADHD), conduct disorder (CD) and LPE. These disorders are frequently comorbid . A meta-analysis found CD in up to 41% of individuals with ADHD . Up to one third of children with CD manifest LPE specifier symptoms . These disorders are known to increment the global burden of disease and have an important implication in the functioning and wellbeing of individuals . Several researchers have tried to study the interaction between them, for example, some studies have demonstrated that boys and girls with CD and meeting criteria for the LPE specifier showed more impairment in psychosocial areas [38,39,40]. In ADHD, impairment and comorbidity with CD may be moderated by LPE characteristics, especially in delinquent  and antisocial behavior . The association between ADHD, CD and LPE also impacts and moderates psychosocial impairment among young adults .
The IEF included separation anxiety disorder (SAND), oppositional defiant disorder (ODD) and IED. SAND and ODD were associated in general population , but there is a lack of information about IED in association with ODD and SAND. Interestingly SAND and ODD present a bi-factorial load: ODD was present in the IEF (0.61) and in the DBF (0.46). Previous reports had described the integration of ODD symptoms grouping with emotional lability and irritability and not only with disruptive behaviors . Furthermore, SAND was present in the IEF (0.62) and the DF (0.41), according to other researchers SAND may fit in irritability and anxiety dimensions . The biggest load in the IEF was for IED (0.9) and did not load into any other factor, which suggests that the characteristics of IED represent the main characteristics of this factor.
The ORF grouped Obsessive Compulsive Disorder (OCD) and ASD. This highlights the repetitive component in these disorders . Finally, the fact that encopresis constituted a single factor, could be related to its complex clinical characteristics and comorbidity [48, 49]. This is further supported by the results of the five and seven factor analysis, in which it loaded on a miscellaneous factor in the former and did not load into any factor on the latter.
The results of the current report correspond, at least in part, to previous reports describing epidemiological samples [15,16,17], particularly in regard to the integration of internalizing disorders as those included in the DF and SHF, as well as in the externalizing disorders, as shown in the DBF, IEF.
Inter-rater reliability was high for CD, ADHD and ODD, but low for NSSI, LPE and PTSD. In previous K-SADS-PL studies, the highest inter-rater agreement was for CD [3, 4, 6]. Clinical presentation of CD comprises behaviors that are usually easy for most people to recognize. High agreement between raters for ADHD and ODD had also been reported [3, 4, 6]. These results are of relevance since these disorders are among the most common reason for psychiatric consultation in pediatric population. The lowest Kappa values were for LPE (0.29) and PTSD (0.39). Curiously, the interview format for these two disorders do not strictly follow the standard interview format of the K-SADS-PL. The diagnosis of PTSD requires two subsequent different skip criteria, while LPE involves a criterium based on four items. In terms of impact on clinical practice, these aspects may suggest that (i) the instrument format for these two clinical conditions could be improved and (ii) that in order to increase reliability, more accurate training may be needed.
Interestingly, our study reports Kappa values above 0.7 for more than 50% of the disorders which contrasts with the Taiwanese study  where inter-rater agreement never reached values over 0.7 even though both studies established a 90% agreement in their training procedures. This could be explained by several factors: (i) the clinical versus the school-based sample, (ii) the more severe symptomatology and (iii) easier recognition in the clinical population.
Some study limitations should be considered. Although it is a Latin American multi-center study, not all the centers provided an equal number of cases which limited hemispheric representation. The sample size is small relative to the number of variables included in the factor analysis, this was due to the comprehensive nature of K-SADS-PL, which comprises a large number of diagnostic categories (N = 43). Sample sizes in this range can be seen in other studies evaluating the psychometric properties of the interview [4, 5, 8, 10]. To somewhat reduce this problem, we removed disorders with a low prevalence from the factor analysis. Furthermoe, the relatively small number of cases with some DSM-5 diagnosis only allowed to established 13 Kappa values, although it surpasses diagnoses number in previous Spanish K-SADS-PL version.
Application of the K-SADS-PL-5 Spanish version, which incorporates changes in the DSM-5, yielded factors that showed coherence with DSM-5 diagnostic groups. Also, a good inter-rater reliability was obtained for major disorders. All these elements make it a useful tool for clinical research studies in children and adolescents.
Attention Deficit Hyperactivity Disorder
Avoidant Restrictive Food Intake Disorder
Autism Spectrum Disorder
Binge Eating Disorder
Child Behavioral Check List
Disruptive Behavior Factor
Disruptive Mood Dysregulation Disorder
Diagnostic and Statistical Manual for Mental Disorders fifth edition
Diagnostic and Statistical Manual for Mental Disorders fourth edition
General Assessment Function Scale
Intermittent Explosive Disorder
Irritable Explosive Factor
Inter Quartile Range
Schedule for Affective Disorders and Schizophrenia for School Age Children Present and Life Time Version
Schedule for Affective Disorders and Schizophrenia for School Age Children Present and Life Time Version DSM-5
Limited Prosocial Emotions
Major Depressive Disorder
Non Suicidal Self Injury
Obsessive Compulsive Disorder
Oppositional Defiant Disorder
Obsessive Repetitive Factor
Post Traumatic Stress Disorder
Social Anxiety Disorder
Separation Anxiety Disorder
Stress Hyperarousal Factor
World Health Organization Disability Assessment Scale
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-IV). 4th ed. Washington, DC: American Psychiatric Association; 1994.
Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36(7):980–8.
Ulloa RE, Ortiz S, Higuera F, Nogales I, Fresan A, Apiquian R, et al. Interrater reliability of the Spanish version of schedule for affective disorders and schizophrenia for school-age children--present and lifetime version (K-SADS-PL). Actas Esp Psiquiatr. 2006;34(1):36–40.
Kim YS, Cheon KA, Kim BN, Chang SA, Yoo HJ, Kim JW, et al. The reliability and validity of kiddie-schedule for affective disorders and schizophrenia-present and lifetime version- Korean version (K-SADS-PL-K). Yonsei Med J. 2004;45(1):81–9.
Lauth B, Arnkelsson GB, Magnusson P, Skarpheethinsson GA, Ferrari P, Petursson H. Parent-youth agreement on symptoms and diagnosis: assessment with a diagnostic interview in an adolescent inpatient clinical population. J Physiol Paris. 2010;104(6):315–22.
Ghanizadeh A, Mohammadi MR, Yazdanshenas A. Psychometric properties of the Farsi translation of the kiddie schedule for affective disorders and schizophrenia-present and lifetime version. BMC Psychiatry. 2006;6:10.
Ghanizadeh A, Jafari P. Cultural structures of the Persian parents' ratings of ADHD. J Atten Disord. 2010;13(4):369–73.
Brasil HH, Bordin IA. Convergent validity of K-SADS-PL by comparison with CBCL in a Portuguese speaking outpatient population. BMC Psychiatry. 2010;10:83.
Chen YL, Shen LJ, Gau SS. The mandarin version of the kiddie-schedule for affective disorders and schizophrenia-epidemiological version for DSM-5 - a psychometric study. J Formos Med Assoc. 2017;116(9):671–8.
Kariuki SM, Newton C, Abubakar A, Bitta MA, Odhiambo R, Phillips OJ. Evaluation of psychometric properties and factorial structure of ADHD module of K-SADS-PL in children from rural Kenya. J Atten Disord. 2018;1087054717753064
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5). 5th ed. Washington, DC: American Psychiatric Association; 2013.
Rutter M. Research review: child psychiatric diagnosis and classification: concepts, findings challenges and potential. J Child Psychol Psychiatry. 2011;52(6):647–60.
Regier DA. Dimensional approaches to psychiatric classification: refining the research agenda for DSM-V: an introduction. Int J Methods Psychiatr Res. 2007;16(Suppl 1):S1–5.
Kendell R, Jablensky A. Distinguishing between the validity and utility of psychiatric diagnoses. Am J Psychiatry. 2003;160(1):4–12.
Lahey BB, Rathouz PJ, Van Hulle C, Urbano RC, Krueger RF, Applegate B, et al. Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. J Abnorm Child Psychol. 2008;36(2):187–206.
Lahey BB, Applegate B, Waldman ID, Loft JD, Hankin BL, Rick J. The structure of child and adolescent psychopathology: generating new hypotheses. J Abnorm Psychol. 2004;113(3):358–85.
Kessler RC, Avenevoli S, McLaughlin KA, Green JG, Lakoma MD, Petukhova M, et al. Lifetime co-morbidity of DSM-IV disorders in the US National Comorbidity Survey Replication Adolescent Supplement (NCS-A). Psychol Med. 2012;42(9):1997–2010.
Blanco C, Wall MM, He JP, Krueger RF, Olfson M, Jin CJ, et al. The space of common psychiatric disorders in adolescents: comorbidity structure and individual latent liabilities. J Am Acad Child Adolesc Psychiatry. 2015;54(1):45–52.
Steinhausen HC, Erdin A. The inter-rater reliability of child and adolescent psychiatric disorders in the ICD-10. J Child Psychol Psychiatry. 1991;32(6):921–8.
Stuart H, Sartorius N, Liinamaa T. The images of psychiatry scale: development, factor structure and reliability. BMC Psychiatry. 2014;14:337.
Ferchiou A, Todorov L, Lajnef M, Baudin G, Pignon B, Richard JR, et al. Schizotypal personality questionnaire-brief - Likert format: factor structure analysis in general population in France. Encéphale. 2017;43(6):558–63.
Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20.
Team RC. A language and environment for statistical computing. Vienna, Austria: foundation for statistical Computing; 2014.
de la Pena FR, Rosetti MF, Rodriguez-Delgado A, Villavicencio LR, Palacio JD, Montiel C, et al. Construct validity and parent-child agreement of the six new or modified disorders included in the Spanish version of the Kiddie Schedule for Affective Disorders and Schizophrenia present and Lifetime Version DSM-5 (K-SADS-PL-5). J Psychiatr Res. 2018;101:28–33.
Nock MK, Joiner TE Jr, Gordon KH, Lloyd-Richardson E, Prinstein MJ. Non-suicidal self-injury among adolescents: diagnostic correlates and relation to suicide attempts. Psychiatry Res. 2006;144(1):65–72.
Mayer Villa PA, Morales Gordillo N, Victoria Figueroa G, Ulloa Flores RE. Adolescentes con autolesiones e ideación suicida: un grupo con mayor comorbilidad y adversidad psicosocial. Salud pública Mex. 2016;58(3):335–6.
Vidal-Ribas P, Brotman MA, Valdivieso I, Leibenluft E, Stringaris A. The status of irritability in psychiatry: a conceptual and quantitative review. J Am Acad Child Adolesc Psychiatry. 2016;55(7):556–70.
Steinhausen HC, Wachter M, Laimbock K, Metzke CW. A long-term outcome study of selective mutism in childhood. J Child Psychol Psychiatry. 2006;47(7):751–6.
Nikolic M, Aktar E, Bogels S, Colonnesi C, de Vente W. Bumping heart and sweaty palms: physiological hyperarousal as a risk factor for child social anxiety. J Child Psychol Psychiatry. 2018;59(2):119–28.
Dakanalis A, Zanetti MA, Colmegna F, Riva G, Clerici M. Classifying binge eating-disordered adolescents based on severity levels. J Adolesc. 2018;62:47–54.
Asselmann E, Stender J, Grabe HJ, Konig J, Schmidt CO, Hamm AO, et al. Assessing the interplay of childhood adversities with more recent stressful life events and conditions in predicting panic pathology among adults from the general population. J Affect Disord. 2018;225:715–22.
Palmisano GL, Innamorati M, Vanderlinden J. Life adverse experiences in relation with obesity and binge eating disorder: a systematic review. J Behav Addict. 2016;5(1):11–31.
Mason SM, Frazier PA, Austin SB, Harlow BL, Jackson B, Raymond NC, et al. Posttraumatic stress disorder symptoms and problematic overeating behaviors in young men and women. Ann Behav Med. 2017;51(6):822–32.
Andrade BF, Waschbusch DA, Doucet A, King S, MacKinnon M, McGrath PJ, et al. Social information processing of positive and negative hypothetical events in children with ADHD and conduct problems and controls. J Atten Disord. 2012;16(6):491–504.
Erskine HE, Ferrari AJ, Nelson P, Polanczyk GV, Flaxman AD, Vos T, et al. Epidemiological modelling of attention-deficit/hyperactivity disorder and conduct disorder for the global burden of disease study 2010. J Child Psychol Psychiatry. 2013;54(12):1263–74.
Graziano PA, Ros R, Haas S, Hart K, Slavec J, Waschbusch D, et al. Assessing callous-unemotional traits in preschool children with disruptive behavior problems using peer reports. J Clin Child Adolesc Psychol. 2016;45(2):201–14.
Erskine HE, Ferrari AJ, Polanczyk GV, Moffitt TE, Murray CJ, Vos T, et al. The global burden of conduct disorder and attention-deficit/hyperactivity disorder in 2010. J Child Psychol Psychiatry. 2014;55(4):328–36.
McMahon RJ, Witkiewitz K, Kotler JS. Predictive validity of callous-unemotional traits measured in early adolescence with respect to multiple antisocial outcomes. J Abnorm Psychol. 2010;119(4):752–63.
Kahn RE, Frick PJ, Youngstrom E, Findling RL, Youngstrom JK. The effects of including a callous-unemotional specifier for the diagnosis of conduct disorder. J Child Psychol Psychiatry. 2012;53(3):271–82.
Pardini D, Stepp S, Hipwell A, Stouthamer-Loeber M, Loeber R. The clinical utility of the proposed DSM-5 callous-unemotional subtype of conduct disorder in young girls. J Am Acad Child Adolesc Psychiatry. 2012;51(1):62–73.e4.
Waschbusch DA, Willoughby MT. Attention-deficit/hyperactivity disorder and callous-unemotional traits as moderators of conduct problems when examining impairment and aggression in elementary school children. Aggress Behav. 2008;34(2):139–53.
Brammer WA, Lee SS. Impairment in children with and without ADHD: contributions from oppositional defiant disorder and callous-unemotional traits. J Atten Disord. 2012;16(7):535–43.
Babinski DE, Neely KA, Kunselman A, Waschbusch DA. Attention-deficit/hyperactivity disorder and callous-unemotional traits as moderators of conduct problems when examining impairment in emerging adults. Psychiatry Res. 2017;258:525–30.
Martin V, Granero R, Ezpeleta L. Comorbidity of oppositional defiant disorder and anxiety disorders in preschoolers. Psicothema. 2014;26(1):27–32.
Cavanagh M, Quinn D, Duncan D, Graham T, Balbuena L. Oppositional defiant disorder is better conceptualized as a disorder of emotional regulation. J Atten Disord. 2017;21(5):381–9.
Wakschlag LS, Estabrook R, Petitclerc A, Henry D, Burns JL, Perlman SB, et al. Clinical implications of a dimensional approach: the normal:abnormal spectrum of early irritability. J Am Acad Child Adolesc Psychiatry. 2015;54(8):626–34.
Allen A, King A, Hollander E. Obsessive-compulsive spectrum disorders. Dialogues Clin Neurosci. 2003;5(3):259–71.
von Gontard A. Does psychological stress affect LUT function in children? ICI-RS 2011. Neurourol Urodyn. 2012;31(3):344–8.
Joinson C, Heron J, Butler U, von Gontard A. Psychological differences between children with and without soiling problems. Pediatrics. 2006;117(5):1575–84.
The authors would like to thank all the children, adolescents and their parents who participated in the study. Special thanks to Alejandra Fragoso for her help in statistical analysis and to Daniela Morales for her contributions to the English final version.
This research received funding from CONACyT No. 233828. The funding sources were used for fulfilling the training workshops and to buy videocameras for the interviews recording.
Availability of data and materials
The databases used and analyzed during the current study are available from the corresponding author upon reasonable request. The videotapes are not available to protect participants’ confidentiality.
Ethics approval and consent to participate
The present research was approved by the “Comite de Etica e Investigación del Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz”, to be conducted in all participating settings. Written informed assent and consent were obtained from the parent or guardian and the child or adolescent.
FRP and LPC had received funding for research and academic activities from Shire Laboratory, Springer Editorial and the National Council for Science and Technology in Mexico (CONACyT). REU and MR had received funding from CONACyT. All other authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Table S1. Factor analysis on K-SADS-PL-5 diagnoses using 5 factors. Factor name (eigenvalue). Abbreviation: Miscellaneous Factor (MF), Depressive Factor (DF), Disruptive Behavior Factor (DBF), Irritable-Explosive Factor (IEF) and Separation Anxiety Disorder Factor (SADF). Table S2. Factor analysis on K-SADS-PL-5 diagnoses using 7 factors. Factor name (eigenvalue). Abbreviation: Miscellaneous Factor (MF), Depressive Factor (DF), Disruptive Behavior Factor (DBF), Irritable Explosive Factor (IEF), Separation Anxiety Disorder Factor (SADF), Phobic Factor (PhF) and Depressive Obsessive Factor (DOF). (DOC 80 kb)