Skip to main content
  • Research article
  • Open access
  • Published:

Relationship between Massachusetts Youth Screening Instrument-second version and psychiatric disorders in youths in welfare and juvenile justice institutions in Switzerland

Abstract

Background

There is growing evidence that it is important to have well-standardized procedures for identifying the mental health needs of youths in welfare and juvenile justice institutions. One of the most widely used tools for mental health screening in the juvenile justice system is the Massachusetts Youth Screening Instrument-second version (MAYSI-2). To contribute to the body of research examining the utility of the MAYSI-2 as a mental health screening tool; the first objective of the current study was to examine the relationship between the MAYSI-2 and the Schedule for Affective Disorders and Schizophrenia for School-Age Children, Present and Lifetime version (K-SADS-PL) in a sample of Swiss youths in welfare and juvenile justice institutions using a cross-sectional design. Secondly, as the sample was drawn from the French-, German- and Italian-speaking parts of Switzerland, the three languages were represented in the total sample and consequently differences between the language regions were analyzed as well. The third objective was to examine gender differences in this relationship.

Methods

Participants were 297 boys and 149 girls (mean age = 16.2, SD = 2.5) recruited from 64 youth welfare and juvenile justice institutions in Switzerland. The MAYSI-2 was used to screen for mental health or behavioral problems that could require further evaluation. Psychiatric classification was based on the Schedule for Affective Disorders and Schizophrenia for School-Age Children, Present and Lifetime version (K-SADS-PL). Binomial logistic regression analysis was used to predict (cluster of) psychiatric disorders from MAYSI-2 scales.

Results

The regression analyses revealed that the MAYSI-2 scales generally related well to their corresponding homotypic (cluster of) psychiatric disorders. For example, the alcohol/drug use scale identified the presence of any substance use disorder and the suicide ideation scale identified youths reporting suicide ideation or suicide attempts. Several MAYSI-2 scales were also related to heterotypic (cluster of) psychiatric disorders. For example, the MAYSI-2 scale alcohol/drug use, was positively related to any disruptive disorder. Furthermore, the results revealed gender differences in the relationship between the MAYSI-2 and K-SADS-PL (e.g., in the boys’ subsample no MAYSI-2 scale was significantly related to any affective disorder; whereas, in the girls’ subsample the MAYSI-2 scales depressed-anxious and somatic complaints were significantly related to any affective disorder).

Conclusions

Overall, The MAYSI-2 seems to serve well as a first-stage screen to identify service needs for youths in welfare and juvenile justice institutions in Switzerland. Its effectiveness to identify the presence of (cluster of) psychiatric disorders differs between genders.

Peer Review reports

Background

Across multiple samples and settings, an extensive body of research has documented that a high proportion of youths involved in the juvenile justice system in Europe meet criteria for one or more psychiatric disorders (e.g., [1, 2]). For example, according to the epidemiological study of Dölitzsch et al. [3] 74 % of boys and girls in youth welfare and juvenile justice institutions (n = 483) in Switzerland meet criteria for psychiatric disorders, which include (among others); anxiety disorder, major depression, bipolar disorder, substance abuse and conduct disorder. These rates are even higher for girls than for boys. Scholars have documented that, compared to boys, girls were 1.4 times as likely to have at least one psychiatric disorder [4] and were significantly more likely to have comorbid disorders [5]. Moreover, the association between psychiatric disorders and the involvement in juvenile delinquency has been well established [57]. For example, youths who persistently abuse substances are significantly more likely to have conduct problems compared to non-users [810]. In addition, incarcerated girls report high levels of posttraumatic stress and depressive symptoms, which may be associated with their involvement in delinquent behavior [11]. Consequently, regardless of the nature of the association between psychiatric disorders and the involvement in juvenile delinquency; it is commonly recognized that these youths need treatment for their problems, and that the juvenile justice system should have adequate procedures for treating them [12]. However, a significant number of youths do not receive the appropriate treatment for their mental health problems [13, 14]. In this context, it is important to have well-standardized procedures for identifying the mental health needs of this vulnerable group as appropriate treatment-planning can only occur if reliable identification and description of youths’ mental health needs precede [15].

One of the most widely used tools for mental health screening in the juvenile justice system is the Massachusetts Youth Screening Instrument-second version (MAYSI-2; [16, 17]). The MAYSI-2 was specifically developed, normed and validated to identify youths entering the juvenile justice system in the United States of America (USA) with potential emotional or behavioral problems (e.g., suicidal and aggressive behavior) that could require further (psychiatric) evaluation [18]. The MAYSI-2 is accessible in its usage as it requires no more than 15 min to administer, uses low-cost materials, and requires no special clinical expertise to administer, score and interpret [16]. Subsequently, the MAYSI-2 is currently used in all detention, intake probation, and/or corrections facilities in about 44 states in the USA [18] and has shown to be reliable and valid in diverse samples of detained youths (e.g., [1921]). For these reasons, there are currently systematic evaluations of implementing the MAYSI-2 into the juvenile justice system in Europe [2224]. Although the MAYSI-2 was not developed to diagnose specific psychiatric disorders, its aim to screen for youths who may have psychiatric disorders indicates that MAYSI-2 scale scores are at least related to psychiatric disorders [21, 22, 25]. To our knowledge, the relationship between the MAYSI-2 scales and psychiatric disorders has only been studied in a few American and European samples of detained male and female youths (e.g., [21, 22, 2628]). The results of these studies supported the construct validity of the MAYSI-2. It was found that some scales of the MAYSI-2 identified the presence of psychiatric disorders better than others; for example, the alcohol/drugs use scale of the MAYSI-2 was positively related to any substance use disorder. However, for girls, the traumatic experiences scale was not related to the any anxiety disorder cluster [21].

To further these studies, the primary purpose of the current study was to examine the relationship between the MAYSI-2 and the Schedule for Affective Disorders and Schizophrenia for School-Age Children Present and Lifetime version (K-SADS-PL) in a sample of Swiss youths in welfare and juvenile justice institutions using a cross-sectional design. Secondly, as the sample was drawn from the French-, German- and Italian-speaking parts of Switzerland, the three languages were represented in the total sample and consequently we could check for differences between the language regions. In view of the research suggesting that girls are more likely than boys to meet criteria for at least one psychiatric disorder or to have comorbid disorders [4, 5], the third objective of this study was to build on previous research by addressing possible gender differences in the relationship between the MAYSI-2 scales and the K-SADS-PL. Gaining greater insight into the utility of the MAYSI-2 is essential for optimizing the identification of mental health needs of youths admitted to the juvenile justice system in order to place them in appropriate treatment programs, and eventually help them to recover from their severe mental health problems [15].

Methods

Procedure

The current study was part of the larger Swiss study for clarification and goal-attainment in youth welfare and juvenile justice institutions, involving the standardized monitoring and evaluation of mental health problems of youths in welfare and juvenile justice institutions in Switzerland [29]. In our sampling procedure, all welfare and juvenile justice institutions with an official registration of the Swiss Federal Office of Justice (Bundesamt für Justiz, BJ) were invited to participate in the study. The BJ institutions represent institutions with different types of infrastructure (e.g., large versus small institutions, institutions with or without intern elementary schools, and internal versus external access to treatment programs). In addition, the BJ institutions reside a heterogeneous group of youths with even differences in youths between institutions (e.g., age, gender and reason for stay). However, the participating BJ institutions (35 %, N = 64) form a representative sample of the different types of institutions as well as of the youths who reside in them [29].

Adolescents who were admitted to one of the 64 facilities between 2007 and 2011 were asked to participate; with the exception of those who had a placement shorter than one month and those who, due to language problems, were not able to complete the French, German or Italian assessment tools. Adolescents and their primary caregivers were individually approached by trained staff of the institution who explained the aims and nature of the study. Following Swiss legislation, active informed consent was collected and, if the adolescent was younger than age 18, parental/primary caregiver informed consent was obtained as well.

The study was reviewed by the Ethics Review Committees of Basel, Lausanne (Switzerland) and Ulm (Germany). A total of 592 (32 %) adolescents from the 64 youth welfare and juvenile justice institutions, in the French- (20 facilities), German- (38 facilities) and Italian-speaking (6 facilities) parts of Switzerland were involved in the study.

The representativeness of the sample was checked by comparing the study sample with matched (i.e., on age and gender) adolescents who refused to participate in the study. The professional caregivers were asked to complete either the Child Behavior Checklist (CBCL; [30]) or the Young Adult Behavior Checklist (YABCL; [31]). CBCL or YABCL information was available for 94 % of all youths, the frequency of adolescents who scored in the clinical range on the internalizing-, externalizing- and total problems scale of the CBCL or the YABCL did not differ between both groups, which suggests that the sample was representative for youths in welfare and juvenile justice institutions in Switzerland. It is important to note that in Switzerland, youths can be placed in welfare and juvenile justice institutions because of: delinquent behavior (criminal law measure), youth welfare reasons (civil law measure, e.g., maltreatment, parental psychopathology, prostitution and drug abuse) or other reasons (e.g., their own or parents’ choice). These three groups currently reside in the same facilities.

Participants

For the current study, data from 446 adolescents who completed both the MAYSI-2 and the Schedule for Affective Disorders and Schizophrenia for School-Age Children, Present and Lifetime version (K-SADS-PL) were analyzed. The adolescents’ ages ranged from 9 to 25 years (mean = 16.2, SD = 2.5). Among the 297 (66.6 %) boys and 149 (33.4 %) girls, 23.2 % were placed in the facility under a criminal law measure, 58.5 % under a civil law measure and 18.4 % because of other reasons. Of the total sample 14.8 % were from the French-speaking, 76.5 % from the German-speaking and 8.7 % from the Italian-speaking part of Switzerland. Most adolescents (83.9 %) were of Swiss nationality, with 77.1 % born in Switzerland and 22.9 % born in other countries.

Since differences between the French-speaking and Italian-speaking subsample were small (i.e., age, gender, reason for stay, country of birth, MAYSI-2 scores and percentage of adolescents with (cluster of) psychiatric disorders), and because of small sample sizes (details available upon request from the first author), the French/Italian-speaking subsamples were combined in the analyses.

Assessment

Demographics

Background information (i.e., age, gender, reason for stay, language region, nationality and country of birth) was extracted by local staff from personal records. For the analyses the following variables were dichotomized: reason for stay (criminal law measure versus civil law measure/other reasons), language region (German versus French/Italian) and country of birth (Switzerland versus not Switzerland).

MAYSI-2

The French, German and Italian versions of the computerized MAYSI-2 [17] were used to screen for mental health or behavioral problems that could require further evaluation. It is important to note that when implementing the Swiss study for clarification and goal-attainment in youth welfare and juvenile justice institutions all youths residing in the institutions were asked to participate at one point of time, therefore all participating youths were screened with the MAYSI-2 at different time points after their facility intake (M = 18.5 months; SD = 21.9).

The MAYSI-2, designed specifically for use in the juvenile justice system, is a self-report questionnaire consisting of 52 items. The respondent rates the questions with yes (1 point) or no (0 points). The MAYSI-2 generates seven scales: alcohol/drug use, angry-irritable, depressed-anxious, somatic complaints, suicide ideation, thought disturbance and traumatic experiences. Of the seven scales, thought disturbance was not included in the current study, as it has been found to be a reliable scale only for boys. In addition, the thought disturbance scale would be related to any schizophrenic or any other psychotic disorder. However, only 5 youths were diagnosed as such so the n of this group was too small to include in the analyses. All of the scales, with the exception of the traumatic experiences scale, generate two types of cut-off scores: a ‘caution’ cut-off, to identify youths with a clinically relevant score; and a ‘warning’ cut-off, to identify youths most in need of attention. In the current study the ‘caution’ cut-off was used, as we were interested in identifying all youths with a possible basis for concern [16]. For the traumatic experiences scale, a cut-off score of 3 was used as it has been shown to be a promising cut-off to identify youths with symptoms of posttraumatic stress disorder (PTSD; [32]).

Earlier research on this questionnaire in juvenile justice samples displayed satisfactory psychometric properties [19, 3335]. In the current study, Cronbach’s alpha coefficients of the scales ranged from .67 to .88, except for the traumatic experiences scale for boys (.59). An alpha lower than .60 can be considered insufficient [36]. In addition, adding the traumatic experiences scale for boys into the regression analyses did not reveal any significant results, nor did it change any of the other results. For these reasons the traumatic experiences scale for boys was not included in our final analyses (details available upon request from the first author).

K-SADS-PL

Psychiatric classification was based on the French [37], German [38] and Italian [39] translation of the K-SADS-PL [40]. The K-SADS-PL was administered by experienced psychologists. The psychologists were trained in a number of sessions in administering the K-SADS-PL by a child and adolescent psychiatrist and a psychologist who was experienced in the use of this instrument. During the study, the trained psychologists were monthly supervised in study team meetings. Agreement on ambiguous K-SADS-PL cases was reached in those team meetings. It is important to note that the trained psychologists were instructed to administer the K-SADS-PL interview as soon as possible (within 3 months) after the youths were screened with the MAYSI-2. However, due to conflicting schedules of youths, there could have been some exceptions.

The K-SADS-PL is a semi-structured interview used to assess a wide range of axis-I disorders. In the current study the K-SADS-PL was used to ascertain specific diagnoses (based on the 10th revision of the International Statistical Classification of Diseases and Related Health Problems; ICD-10) grouped into five diagnostic clusters for the analyses: (1) any substance use disorder included abuse/dependence of alcohol and other substances; (2) any affective disorder included depressive, bipolar or manic disorders; (3), any anxiety disorder included obsessive-compulsive, generalized anxiety, phobic disorders, PTSD and acute stress reactions; (4) any disruptive behavior disorder included hyperkinetic, oppositional and conduct disorders and (5) suicide ideation/suicide attempts included thoughts about death, suicide ideation and suicidal actions.

The K-SADS-PL has been widely used in clinical settings and has displayed satisfactory psychometric properties in French [4143], German [44] and Italian [45] child and adolescent psychiatric samples. In the current study, inter-rater reliability of the K-SADS-PL was assessed for the most prevalent disorder supplements (i.e., depression, attention deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder, alcohol abuse and substance abuse). Cohen's kappa coefficients of these supplements were: .76 (depression), .87 (attention deficit hyperactivity disorder), .37 (oppositional defiant disorder), .43 (conduct disorder), 1.00 (alcohol abuse), and .86 (substance abuse).

Statistics

First, we generated descriptive statistics (using Statistical Package for Social Science, SPSS, 21) for the study variables and compared demographics (i.e., age, gender, reason for stay, language region and country of birth), MAYSI-2 scores, and (cluster of) psychiatric disorders across language regions and gender via t-test and chi-square analyses.

Next, binomial logistic regression analysis was used to predict (cluster of) psychiatric disorders from MAYSI-2 scales. Although the MAYSI-2 was not developed to diagnose specific psychiatric disorders, its aim to screen for youths who may have psychiatric disorders indicates that MAYSI-2 scale scores are at least related to psychiatric disorders [21, 22, 25]. Following a study by Wasserman et al. [21], we similarly related MAYSI-2 scales to (cluster of) psychiatric disorders. As youths in welfare and juvenile justice institutions are likely to have comorbid disorders [5], MAYSI-2 scales were related to both homotypic and heterotypic (cluster of) psychiatric disorders. Relationships between MAYSI-2 scales and (cluster of) psychiatric disorders sharing the same underlying constructs were defined as homotypic mappings (i.e., relationships between disorders within a diagnostic grouping). Consequently; we related the MAYSI-2 scale alcohol/drug use to any substance use disorder, the MAYSI-2 scale angry-irritable to any disruptive behavior disorder, the MAYSI-2 scales depressed-anxious and somatic complaints to any affective and any anxiety disorder, and the MAYSI-2 scale suicide ideation to suicide ideation/suicide attempts. Note that the MAYSI-2 scale somatic complaints asks about bodily aches and pains associated with affective or anxiety disorders [16] and was therefore related to any affective and any anxiety disorder. Relationships between MAYSI-2 scales and (cluster of) psychiatric disorders not sharing the same underlying constructs were defined as heterotypic mappings (i.e., relationships between disorders from different diagnostic groupings). Consequently, we related the MAYSI-2 scales to all remaining, not-homotypic (cluster of) psychiatric disorders. Homotypic mappings are indicated with bordered cells in Table 2, Table 3 and Table 4.

As we were interested in differences between the language regions and possible gender differences in the relationship between the MAYSI-2 scales and the K-SADS-PL, we performed analyses on five separate subsamples: total sample, German-speaking subsample, French/Italian-speaking subsample, boys and girls.

In the regression analyses two groups of independent variables were entered simultaneously. The first group, which is only described in the tables, contained age, gender (not included in the gender subsample analyses), reason for stay, and language region (not included in the language region subsample analyses). In this way we adjusted for age, gender, reason for stay, and language region in the designated subsamples. The second group contained the MAYSI-2 scales.

Results

Descriptives and comparisons across subsamples (German-speaking and French/Italian-speaking, boys and girls)

The following percentages of youths scored at or above the ‘caution’ cut-off on one or more MAYSI-2 scale: alcohol/drug use (33 %), angry-irritable (51.8 %), depressed-anxious (50 %), somatic complaints (34.8 %), suicide ideation (41.9 %), traumatic experiences (girls only; 48.3 %) and 77.1 % scored at or above any ‘caution’ cut-off (excluding traumatic experiences). Of the total sample, 15 % were diagnosed with any substance use disorder, 15.9 % with any affective disorder, 10.8 % with any anxiety disorder, 47.1 % with any disruptive behavior disorder and 21.9 % with suicide ideation and suicide attempts.

Adolescents of the French/Italian-speaking subsample scored significantly higher than adolescents of the German-speaking subsample on the MAYSI-2 scales: angry-irritable, depressed-anxious and somatic complaints. Adolescents of the German-speaking subsample scored significantly higher than adolescents of the French/Italian-speaking subsample on the alcohol/drug use scale. No significant differences were found on the suicide ideation scale. Considering (cluster of) psychiatric disorders; a significantly higher proportion of adolescents of the French/Italian-speaking subsample had any affective disorder, any anxiety disorder, and suicide ideation and suicide attempts than adolescents of the German-speaking subsample. A significantly higher proportion of adolescents from the German-speaking subsample met criteria for any disruptive behavior disorder than adolescents from the French/Italian-speaking subsample. No significant differences were found between the language regions for any substance use disorder.

MAYSI-2 means were compared across gender and girls scored significantly higher than boys on the scales: angry-irritable, depressed-anxious, somatic complaints and suicide ideation. No significant differences were found on the alcohol/drug scale. Considering (cluster of) psychiatric disorders; girls were more likely than boys to meet criteria for any affective disorder, any anxiety disorder and suicide ideation and suicide attempts. Girls were less likely than boys to meet criteria for any disruptive behavior disorder. No significant differences were found for any substance use disorder (see Table 1 for comparisons across subsamples).

Table 1 Comparisons across subsamples (German-speaking and French/Italian-speaking, boys and girls)

Logistic regression

Results for the logistic regression analyses on the total sample (Table 2), showed that most homotypic mappings yielded significantly elevated odds ratios (ORs); with the exception of the somatic complaints scale. Youths in the total sample with a score at or above the caution cut-off on the MAYSI-2 scale somatic complaints were less likely to have any affective disorder. The depressed-anxious and somatic complaints scales revealed no significant OR for any anxiety disorder. Several heterotypic mappings also yielded significant ORs; the alcohol/drug scale revealed a significant OR for any anxiety disorder and for any disruptive disorder.

Table 2 Logistic regression odds ratios for MAYSI-2 Scales (total sample)

The results of the logistic regression analyses on the German-speaking and the French/Italian-speaking subsample (Table 3) were comparable to the results of the total sample. Except for the German-speaking subsample, only the depressed-anxious scale revealed a significantly elevated OR for any affective disorder and no MAYSI-2 scale revealed a significantly elevated OR for any anxiety disorder. In the French/Italian-speaking subsample, the alcohol/drug use scale did not reveal a significantly elevated OR for any substance abuse disorder and the angry-irritable scale did not reveal a significant OR for any disruptive disorder when compared to the total sample.

Table 3 Logistic Regression Odds Ratios for MAYSI-2 Scales (German-speaking and French/Italian-speaking Subsample)

The results predicting (cluster of) psychiatric disorders for boys (Table 4) showed that boys with a score at or above the caution cut-off on the MAYSI-2 scale alcohol/drug use were more likely to have any substance use disorder or to have any disruptive behavior disorder. However, boys with a score at or above the caution cut-off on the MAYSI-2 scale alcohol/drug use were less likely to have any anxiety disorder. Further, boys with a score at or above the caution cut-off on the MAYSI-2 scale suicidal ideation were more likely to have suicide ideation and suicidal actions. In the boys’ subsample, no MAYSI-2 scale revealed a significant OR for any affective disorder. The results predicting (cluster of) psychiatric disorders for girls (Table 4) showed that girls with a score at or above the caution cut-off on the MAYSI-2 scale alcohol/drug use or traumatic experiences were more likely to have any substance use disorder. Girls with a score at or above the caution cut-off on the MAYSI-2 scale depressed-anxious were more likely to have any affective disorder; whereas girls with a score at or above the caution cut-off on the MAYSI-2 scale somatic complaints were less likely to have any affective disorder. Further, girls with a score at or above the caution cut-off on the MAYSI-2 scales alcohol/drug use or angry-irritable were more likely to have any disruptive disorder. Girls with a score at or above the caution cut-off on the MAYSI-2 scale suicidal ideation were more likely to have suicide ideation and suicidal actions. In the girls’ subsample, no MAYSI-2 scale revealed a significant OR for any anxiety disorder.

Table 4 Logistic Regression Odds Ratios for MAYSI-2 Scales (Boys and Girls)

Discussion

The primary purpose of the current study was to examine the relationship between the MAYSI-2 and the K-SADS-PL in a sample of Swiss youths (i.e., French, German and Italian language regions) in welfare and juvenile justice institutions using a cross-sectional design. The results of the analyses on the total sample are consistent with previous research [21, 22, 2628] that has found the MAYSI-2 scales to be generally well-related to their corresponding homotypic (cluster of) psychiatric disorders. For example, the alcohol/drug use scale identified the presence of any substance use disorder, the angry-irritable scale related well to any disruptive behavior disorder and the suicide ideation scale identified youths reporting suicide ideation or suicide attempts. Surprisingly, within the total sample, those who scored at or above the caution cut-off on the MAYSI-2 scale somatic complaints were less likely to have any affective disorder. Comparable results were found in the French/Italian-speaking and girls’ subsamples. In the German-speaking and boys’ subsamples the somatic complaints scale revealed no significant OR for any affective disorder. This finding is difficult to interpret, but it may be explained by the possibility that Swiss youths mention their actual physical illnesses on the somatic complaints scale rather than bodily aches and pains associated with affective or anxiety disorders. Additional research is needed to investigate the predictive value of the somatic complaints scale in other (language) subsamples.

Further, of the total sample, youths who scored at or above the caution cut-off on the MAYSI-2 scale alcohol/drug use were less likely to have any anxiety disorder. Comparable results were found in the French/Italian-speaking and boys’ subsamples. An explanation may be that, in some youths, alcohol/drug use helps to reduce symptoms of anxiety, and subsequently an anxiety disorder is difficult to detect. Additionally, in the total sample, the MAYSI-2 scales depressed-anxious and somatic complaints did not predict any anxiety disorder. Comparable results were found in all the other subsamples (i.e., German-speaking and French/Italian-speaking subsample, boys and girls). An explanation for this finding may be that the variable language region influenced the relationship between the depressed-anxious and somatic complaints scales, and any anxiety disorder. This reasoning is supported by the fact that when the variable language region (which contributed strongly to any anxiety disorder) was left out of the regression analysis, the depressed-anxious scale contributed significantly to any anxiety disorder. In further support of this reasoning, we found that the correlations between the depressed-anxious and somatic complaints scales, and any anxiety disorder were higher than the (negative) correlation between the alcohol/drug scale and any anxiety disorder. However, the correlations between the depressed-anxious and somatic complaints scales, and language region were higher than the correlations between both scales and any anxiety disorder. As mentioned above it may be that Swiss youths mention their actual physical illnesses on the somatic complaints scale rather than bodily aches and pains associated with affective or anxiety disorders. In addition, in the Wasserman study [21] an elevated OR was found for the depressed-anxious scale for any affective and any anxiety disorder (the somatic complaints scale was not included in the analyses). Consequently, another explanation may be that, the aim of the depressed-anxious scale (i.e., reveal depressed or anxious moods and problems) is less well covered in the translated versions of the MAYSI-2.

Furthermore, and consistent with Wasserman et al. [21], several MAYSI-2 scales were related to heterotypic (cluster of) psychiatric disorders. For example, in the total sample the MAYSI-2 scale alcohol/drug use, was positively related to any disruptive disorder. Comparable results were found in all the other subsamples (i.e., German-speaking and French/Italian-speaking subsample, boys and girls). An explanation for this may be found in the co-occurrence of substance abuse with disruptive disorders, as it is well documented [810] that disruptive disorders in youths are significantly related to problems associated with drug and alcohol abuse.

Overall, the MAYSI-2 scales related well to their corresponding homotypic (cluster of) psychiatric disorders in the German-speaking and French/Italian-speaking subsamples. Although small discrepancies between both samples (e.g., relationship between MAYSI-2 scales, and any affective and any anxiety disorder) were observed, the MAYSI-2 seems to serve well as a first-stage screen to identify service needs for youths in welfare and juvenile justice institutions in the French-, German- and Italian-speaking parts of Switzerland.

The third purpose of the current study was to build on previous research by addressing gender differences in the relationship between the MAYSI-2 scales and (cluster of) psychiatric disorders. The results of the analyses on the boys’ subsample showed that no MAYSI-2 scale was significantly related to any affective disorder. In addition, the MAYSI-2 scale angry-irritable was not significantly related to any disruptive behavior disorder. As the identification of (cluster of) psychiatric disorders in juvenile justice youths is influenced by gender variations in symptom expression (boys tend to reveal their feelings on self-report scales less readily than girls; [16]), it may be reasonable to suggest that the current caution cut-off scores for boys under-detect certain disorders. Furthermore, the traumatic experiences scale of the MAYSI-2 was developed to indicate only the degree to which youths had been exposed to traumatic experiences and not to indicate the presence of a psychiatric disorder [16]. It is noteworthy that in the girls’ subsample, the traumatic experiences scale significantly predicted any substance abuse disorder. Prior research has documented that traumatization and victimization experiences may be a risk factor in girls in understanding disruptive and substance abusing behavior [46, 47]. Therefore, this finding may indicate that the MAYSI-2 scale traumatic experiences is able to identify substance abusing behavior associated with exposure to traumatic experiences in this subsample. The MAYSI-2 scale suicide ideation was significantly related to suicide ideation/suicide attempts in both the boys’ and girls’ subsample. This finding is in line with one of the aims of the MAYSI-2, which is to identify youths who may be a danger to themselves and are in need of direct attention [16].

Several limitations should be mentioned. First, we should note that several findings of the current study should be interpreted with caution as low power (due to the relatively small number of girls (n = 18) and youths from the French/Italian-speaking subsample (n = 14) diagnosed with any substance use disorder) may have influenced the results. In addition, the inter-rater reliability of the oppositional defiant disorder and conduct disorder supplement of the K-SADS-PL was relatively low and may have influenced the results as well. Several explanations for the low inter-rater reliability could be the case; one explanation may be that, juveniles with a very clear/obvious ODD or CD diagnosis may have refused to get their interviews taped. Also, about 60 % of our sample fulfilled criteria for more than one diagnosis, the high co-morbidity may have reduced the inter-rater reliability for specific diagnoses. Another explanation may be that the different languages (i.e., French, German and Italian) of the interviewers influenced the inter-rater reliability. However, agreement on ambiguous K-SADS-PL (real) cases was reached in study team meetings.

Another limitation is that, when scoring the MAYSI-2 norm scores of juvenile justice youths in the USA [16] were used and juvenile justice populations, due to differences in juvenile justice systems and policies, may not be similar in Switzerland and the USA. Furthermore, the MAYSI-2 is a mental health screening tool created for youths between 12 and 17 years of age, and approximately 20 % of the present sample was 18 years of age or older. Although previous research [22] has shown that the psychometric properties of the MAYSI-2 are well supported in this age group, future studies are needed to test whether the relationship between the MAYSI-2 and (cluster of) psychiatric disorders are similar across different age groups. Lastly, due to the study design and due to conflicting schedules of youths; the time that passed between facility intake and the MAYSI-2 screening, and the time that passed between the MAYSI-2 screening and the K-SADS-PL interview was different for all youths and could have influenced the results.

Despite these limitations, the current study leads us to formulate a number of recommendations for future research. First, since the prevalence of traumatization and victimization among boys in youth welfare and juvenile justice institutions should not be overlooked [48], future research should investigate whether the traumatic experiences scale of the MAYSI-2 is able to identify the presence of (cluster of) psychiatric disorders associated with exposure to traumatic experiences in boys. In addition, with regard to the discussion about a new diagnosis to capture what chronically trauma exposed youths suffer from (i.e., complex PTSD or developmental trauma disorder) [47, 49] it would be usefull to investigate whether the traumatic experiences scale of the MAYSI-2 is able to identify this potential new diagnosis. Second, as in some cases the variable language region seemed to influence the relationship between the MAYSI-2 and the K-SADS-PL (i.e., between the depressed-anxious and somatic complaints scales, and any anxiety disorder); the results of this study indicate the need to test the relationship between the MAYSI-2 and the K-SADS-PL more elaborately in larger differentiated language samples in Europe. Lastly, as comorbidity is common in youths in welfare and juvenile justice institutions [3, 4, 50], and difficult to detect, future research should explicitly test whether the MAYSI-2 is able to distinguish comorbid (cluster of) psychiatric disorders in these youths.

Conclusions

Our study shows that several MAYSI-2 scales were significantly related to homotypic and heterotypic (cluster of) psychiatric disorders in boys and girls in youth welfare and juvenile justice institutions in Switzerland. These relations were found to differ across language regions and across gender. In addition, our study shows that the MAYSI-2 is able to identify youths who may be a danger to themselves and are in need of direct attention (i.e., youths with suicidal ideation). However, some expected relations were not present (e.g., MAYSI-2 scale depressed-anxious and any anxiety disorder), or harder to interpret (e.g., MAYSI-2 scale somatic complaints and any affective disorder). Overall, the current study contributes to the body of research examining the utility of the MAYSI-2 as a mental health screening tool for youths in welfare and juvenile justice institutions. Psychiatric disorders in youths in welfare and juvenile justice institutions are considerable [13] and appear to be related to one and another (e.g., [810, 46, 47]). Although the separate MAYSI-2 scales were developed to screen for the presence of their corresponding homotypic (cluster of) psychiatric disorders; clinicians and practitioners should also, in their clinical practice, pay attention to the heterotypic (cluster of) psychiatric disorders which may be associated with an elevated score on a certain MAYSI-2 scale.

Abbreviations

CBCL:

Child Behavior Checklist

CI:

Confidence interval

ICD-10:

International Statistical Classification of Diseases and Related Health Problems, 10th revision

K-SADS-PL:

Schedule for Affective Disorders and Schizophrenia for School-Age Children, Present and Lifetime version

MAYSI-2:

Massachusetts Youth Screening Instrument - second version

OR:

Odds ratio

PTSD:

Posttraumatic stress disorder

SPSS:

Statistical Package for Social Sciences

USA:

United States of America

YABCL:

Young Adult Behavior Checklist

References

  1. Colins O, Vermeiren R, Schuyten G, Broekaert E. Psychiatric disorders in property, violent, and versatile offending detained male adolescents. Am J Orthopsychiat. 2009;79(1):31–8.

    Article  PubMed  Google Scholar 

  2. Fazel S, Doll H, Langström N. Mental disorders among adolescents in juvenile detention and correctional facilities: a systematic review and metaregression analysis of 25 surveys. J Am Acad Child Psy. 2008;47(9):1010–9.

    Google Scholar 

  3. Dölitzsch C, Fegert JM, Künster AK, Kölch M, Schmeck K, Schmid M. Mehrfachdiagnosen bei Schweizer Heimjugendlichen. Kindh Entwickl. 2014;23(3):140–50.

    Article  Google Scholar 

  4. Teplin LA, Abram KM, McClelland GM, Dulcan MK, Mericle AA. Psychiatric disorders in youth in juvenile detention. Arch Gen Psychiatry. 2002;59(12):1133–43.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wasserman GA, Mc Reynolds L, Schwalbe CS, Keating JM, Jones SA. Psychiatric disorder, comorbidity, and suicidal behavior in juvenile justice youth. Crim Justice Behav. 2010;37(12):1361–76.

    Article  Google Scholar 

  6. Kataoka SH, Zima BT, Dupre DA, Moreno KA, Yang X, McCracken JT. Mental health problems and service use among female juvenile offenders: their relationship to criminal history. J Am Acad Child Psy. 2001;40(5):549–55.

    Article  CAS  Google Scholar 

  7. Wasserman GA, McReynolds LS, Ko SJ, Katz LM, Carpenter JR. Gender differences in psychiatric disorders at juvenile probation intake. Am J Public Health. 2005;95(1):131–7.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Elkins IJ, McGue M, Iacono WG. Prospective effects of attention-deficit/hyperactivity disorder, conduct disorder, and sex on adolescent substance use and abuse. Arch Gen Psychiat. 2007;64(10):1145–52.

    Article  PubMed  Google Scholar 

  9. Martin CA, Kelly TH, Rayens MK, Brogli B, Himelreick K, Brenzel A, Bingcang CM, Omar H. Sensation seeking and symptoms of disruptive disorder: association with nicotine, alcohol, and marijuana use in early and mid-adolescence. Psychol Rep. 2004;94:1075–82.

    Article  PubMed  Google Scholar 

  10. Neighbors B, Kempton T, Forehand R. Co-occurrence of substance abuse with conduct, anxiety, and depression disorders in juvenile delinquents. Addict Behav. 1992;17(4):379–86.

    Article  CAS  PubMed  Google Scholar 

  11. Wood J, Foy DW, Goguen CA, Pynoos R, James C. Violence exposure and PTSD among delinquent girls. J Aggress Maltreat Trauma. 2002;6(1):109–26.

    Article  Google Scholar 

  12. Vincent GM. Screening and assessment in juvenile justice systems: identifying mental health needs and risk of reoffending. Washington: Technical Assistance Partnership for Child and Family Mental Health; 2011.

    Google Scholar 

  13. Cauffman E. A statewide screening of mental health symptoms among juvenile offenders in detention. J Am Acad Child Psy. 2004;43(4):430–9.

    Article  Google Scholar 

  14. Desai RA, Goulet JL, Robbins J, Chapman JF, Migdole SJ, Hoge MA. Mental health care in juvenile detention facilities: a review. J Am Acad Psychiatry Law. 2006;34(2):204–14.

    PubMed  Google Scholar 

  15. Grisso T. Why we need mental health screening and assessment in juvenile justice programs. In: Grisso T, Vincent G, Seagrave D, editors. Mental health screening and assessment in juvenile justice. New York: Guilford Press; 2005. p. 3–21.

    Google Scholar 

  16. Grisso T, Barnum R. Massachusetts Youth Screening Instrument-version 2 (MAYSI-2): user’s manual and technical report. Sarasota: Professional Resource Press; 2006.

    Google Scholar 

  17. Grisso T, Barnum R. Massachusetts Youth Screening Instrument-version 2 (MAYSI-2): language translations. Sarasota: Professional Resource Press; 2014.

    Google Scholar 

  18. Grisso T, Fusco S, Paiva-Salisbury M, Perrault R, Williams V, Barnum R. The Massachusetts Youth Screening Instrument-version 2 (MAYSI-2): comprehensive research review. Worcester: University of Massachusetts Medical School; 2012.

    Google Scholar 

  19. Ford JD, Chapman JF, Pearson G, Borum R, Wolpaw JM. Psychometric status and clinical utility of the MAYSI-2 with girls and boys in juvenile detention. J Psychopathol Behav. 2008;30(2):87–99.

    Article  Google Scholar 

  20. McCoy H, Vaughn MG, Maynard BR, Salas-Wright CP. Caution or warning? A validity study of the MAYSI-2 with juvenile offenders. Behav Sci Law. 2014;32(4):508–26.

    Article  PubMed  Google Scholar 

  21. Wasserman GA, McReynolds LS, Ko SJ, Katz LM, Cauffman E, Haxton W, et al. Screening for emergent risk and service needs among incarcerated youth: comparing MAYSI-2 and voice DISC-IV. J Am Acad Child Psy. 2004;43(5):629–39.

    Article  Google Scholar 

  22. Colins OF, Grisso T, Mulder E, Vermeiren R. The relation of standardized mental health screening and categorical assessment in detained male adolescents. Eur Child Adoles Psy. 2015;24(3):339–49.

    Article  Google Scholar 

  23. Devlieger E, Verschuere B. Youth delinquents and mental complaints: a study with the revised Massachusetts Youth Screening Instrument (MAYSI-2) with Flemish juvenile boys. Psychol Gezondh. 2010;38(3):138–42.

    Article  Google Scholar 

  24. Lennox C, O’Malley K, Bell V, Shaw J, Dolan M. The validity and clinical utility of the Massachusetts Youth Screening Instrument-version 2 (MAYSI-2) in the UK. Crim Behav Ment Health. 2014;25:207–19.

    Article  PubMed  Google Scholar 

  25. Grisso T, Barnum R, Fletcher KE, Cauffman E, Peuschold D. Massachusetts Youth Screening Instrument for mental health needs of juvenile justice youths. J Am Acad Child Psy. 2001;40(5):541–8.

    Article  CAS  Google Scholar 

  26. Hayes MA, McReynolds LS, Wasserman GA. Paper and voice MAYSI-2: format comparability and concordance with the voice DISC-IV. Assessment. 2005;12(4):395–403.

    Article  PubMed  Google Scholar 

  27. Plattner B, The SS, Kraemer HC, Williams RP, Bauer SM, Kindler J, et al. Suicidality, psychopathology, and gender in incarcerated adolescents in Austria. J Clin Psychiat. 2007;68(10):1593–600.

    Article  Google Scholar 

  28. Wasserman GA, Vilhauer JS, Mc Reynolds L, Shoai R, John R. Mental health screening in the juvenile justice system: a comparison between the voice-DISC-IV and the MAYSI-2. J Juv Justice Deten Serv. 2004;19(1/2):7–17.

    Google Scholar 

  29. Schmid M, Kölch M, Fegert JM, Schmeck K, MAZ.-Team. Abschlussbericht Modellversuch Abklärung und Zielerreichung in stationären Massnahmen. 2013. https://www.bj.admin.ch/dam/data/bj/sicherheit/smv/modellversuche/evaluationsberichte/maz-schlussbericht-d.pdf. Accessed 10 Nov 2015.

  30. Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington: University of Vermont Department of Psychiatry; 1991.

    Google Scholar 

  31. Achenbach TM. Manual for the young adult self-report and Young Adult Behavior Checklist. Burlington: University of Vermont Department of Psychiatry; 1997.

    Google Scholar 

  32. Kerig PK, Moeddel MA, Becker SP. Assessing the sensitivity and specificity of the MAYSI-2 for detecting trauma among youth in juvenile detention. Child Youth Care For. 2011;40(5):345–62.

    Article  Google Scholar 

  33. Archer RP, Simonds-Bisbee EC, Spiegel DR, Handel RW, Elkins DE. Validity of the Massachusetts Youth Screening Instrument-2 (MAYSI-2) scales in juvenile justice settings. J Pers Assess. 2010;92(4):337–48.

    Article  PubMed  Google Scholar 

  34. Butler MA, Loney BR, Kistner J. The Massachusetts Youth Screening Instrument as a predictor of institutional maladjustment in severe male juvenile offenders. Crim Justice Behav. 2007;34(4):476–92.

    Article  Google Scholar 

  35. Colins OF, Grisso T, Vahl P, Guy L, Mulder E, Hornby N, et al. Standardized screening for mental health needs of detained youths from various ethnic origins: the Dutch Massachusetts Youth Screening Instrument-second version (MAYSI-2). J Psychopathol Behav. 2015;37(3):481–92.

    Article  Google Scholar 

  36. Kline P. The handbook of psychological testing. 2nd ed. Oxon: Routledge; 2000.

    Google Scholar 

  37. Mouren-Siméoni M, Cook S, Flament M, Nedey-Saiag M, Nollet-Clémençon C, Paillère-Martinot M. Kiddie-SADS-version vie entière (K-SADS-PL). Edition révisée et modifiée. Paris: INSERM; 2002.

    Google Scholar 

  38. Delmo C, Weiffenbach O, Gabriel M, Stadler C, Poustka F. Diagnostisches Interview Kiddie-Sads-Present and Lifetime Version (K-SADS-PL), Auflage der deutschen Forschungsversion, erweitert um ICD-10-Diagnostik. Frankfurt: Klinik für Psychiatrie und Psychotherapie des Kindes- und Jugendalters; 2001.

    Google Scholar 

  39. Erickson CS. K-SADS-PL: intervista diagnostica per la valutazione dei disturbi psicopatologici in bambini e adolescenti. Manuale e protocolli. Trento: Centro Studi Erickson; 2004.

    Google Scholar 

  40. Kaufman J, Birmaher B, Brent D, Rao U, Ryan N. The Schedule for Affective Disorders and Schizophrenia for School-Age Children - Present and Lifetime version (K-SADS-PL, version 1.0). Pittsburgh: Dept. of Psychiatry, University of Pittsburgh School of Medicine; 1996.

    Google Scholar 

  41. Purper-Ouakil D, Cortese S, Wohl M, Asch M, Acquaviva E, Falissard B, et al. Predictors of diagnostic delay in a clinical sample of French children with attention-deficit/hyperactivity disorder. Eur Child Adoles Psy. 2007;16(8):505–9.

    Article  CAS  Google Scholar 

  42. Vila G, Zipper E, Dabbas M, Bertrand C, Robert JJ, Ricour C, et al. Mental disorders in obese children and adolescents. Psychosom Med. 2004;66(3):387–94.

    PubMed  Google Scholar 

  43. Vila G, Nollet-Clemencon C, de Blic J, Falissard B, Mouren-Simeoni M-C, Scheinmann P. Assessment of anxiety disorders in asthmatic children. Psychosomatics. 1999;40(5):404–13.

    Article  CAS  PubMed  Google Scholar 

  44. Jans T, Weyers P, Schneider M, Hohage A, Werner M, Pauli P, et al. The Kiddie-SADS allows for a dimensional assessment of externalizing symptoms in ADHD children and adolescents. ADHD Atten Def Hyp Disord. 2009;1(2):215–22.

    Article  Google Scholar 

  45. Masillo A, Valmaggia LR, Lanna A, Brandizzi M, Lindau JF, Curto M, et al. Validation of the Italian version of interpersonal sensitivity measure (IPSM) in adolescents and young adults. J Affect Disorders. 2014;156:164–70.

    Article  CAS  PubMed  Google Scholar 

  46. Dixon A, Howie P, Starling J. Trauma exposure, posttraumatic stress, and psychiatric comorbidity in female juvenile offenders. J Am Acad Child Psy. 2005;44:798–806.

    Article  Google Scholar 

  47. Kerig PK, Ward RM, Vanderzee KL, Arnzen MM. Posttraumatic stress as a mediator of the relationship between trauma and mental health problems among juvenile delinquents. J Youth Adolescence. 2009;38:1214–25.

    Article  Google Scholar 

  48. Abram KM, Teplin LA, Charles DR, Longworth SL, McClelland GM, Dulcan MK. Posttraumatic stress disorder and trauma in youth in juvenile detention. Arch Gen Psychiat. 2004;61:403–10.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Schmid M, Petermann F, Fegert JM. Developmental trauma disorder: pros and cons of including formal criteria in the psychiatric diagnostic systems. BMC Psychiat. 2013;13:3.

    Article  Google Scholar 

  50. Abram KM, Teplin LA, McClelland GM, Dulcan MK. Comorbid psychiatric disorders in youth in juvenile detention. Arch Gen Psychiat. 2003;60:1097–108.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Funding

The study was funded by the Federal Office of Justice in Switzerland (Bundesamt für Justiz).

Availability of data and materials

Data will not be made available in order to protect the participants identity.

Authors’ contributions

LL Analysed and interpreted the data, and drafted the manuscript. CD Analysed and interpreted the data, and drafted the manuscript. KS Helped to draft the manuscript and revised the manuscript critically. JF Revised the manuscript critically. TG Revised the manuscript critically. MS Enrolled the study, helped to draft the manuscript and revised the manuscript critically. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

The authors provide formal consent to publish.

Ethics approval and consent to participate

The study was reviewed by the Ethics Review Committees of Basel, Lausanne (Switzerland) and Ulm (Germany).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to L. E. W. Leenarts.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leenarts, L.E.W., Dölitzsch, C., Schmeck, K. et al. Relationship between Massachusetts Youth Screening Instrument-second version and psychiatric disorders in youths in welfare and juvenile justice institutions in Switzerland. BMC Psychiatry 16, 340 (2016). https://doi.org/10.1186/s12888-016-1032-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-016-1032-1

Keywords