Skip to main content

Validation of the German version of the insomnia severity index in adolescents, young adults and adult workers: results from three cross-sectional studies

Abstract

Background

A variety of objective and subjective methods exist to assess insomnia. The Insomnia Severity Index (ISI) was developed to provide a brief self-report instrument useful to assess peopleā€™s perception of sleep complaints. The ISI was developed in English, and has been translated into several languages including German. Surprisingly, the psychometric properties of the German version have not been evaluated, although the ISI is often used with German-speaking populations.

Methods

The psychometric properties of the ISI are tested in three independent samples: 1475 adolescents, 862 university students, and 533 police and emergency response service officers. In all three studies, participants provide information about insomnia (ISI), sleep quality (Pittsburgh Sleep Quality Index), and psychological functioning (diverse instruments). Descriptive statistics, gender differences, homogeneity and internal consistency, convergent validity, and factorial validity (including measurement invariance across genders) are examined in each sample.

Results

The findings show that the German version of the ISI has generally acceptable psychometric properties and sufficient concurrent validity. Confirmatory factor analyses show that a 1-factor solution achieves good model fit. Furthermore, measurement invariance across gender is supported in all three samples.

Conclusions

While the ISI has been widely used in German-speaking countries, this study is the first to provide empirical evidence that the German version of this instrument has good psychometric properties and satisfactory convergent and factorial validity across various age groups and both men and women. Thus, the German version of the ISI can be recommended as a brief screening measure in German-speaking populations.

Peer Review reports

Background

Poor sleep is being increasingly recognised as a widespread and persistent health complaint. Estimates of prevalence of at least one symptom of insomnia stand at between 20 and 30Ā % in adult populations [1], with women typically having an increased risk of insomnia [2, 3]. A close relationship exists between peopleā€™s sleep, their daily well-being [4], memory [5], and daytime performance [6]. Moreover, chronic sleep complaints negatively impact on physical and psychological functioning in children [7], adolescents [8], adults [4], and the elderly [9]. For instance, a wealth of studies shows that sleep complaints are closely associated with depressive symptoms, with correlations ranging between rā€‰=ā€‰.50 and .60 [10, 11].

A variety of objective and subjective methods exist to assess insomnia. Polysomnography and actigraphy are objective methods. They are considered reliable and valid techniques to assess sleep duration and efficiency [12]. However, polysomnography is costly, typically takes place in artificial sleep environments, and is not capable of detecting insomnia against subjective diagnostic criteria [9]. Among the subjective methods, sleep diaries are the most frequently used form of assessment [12, 13]. Although this method is cost-effective and correlates reasonably well with objective methods, sleep diaries depend on the willingness of participants to provide daily reports immediately after awakening over longer periods of time. In contrast, self-report questionnaires can be used to collect data on sleep problems with minimal effort and cost, while providing information about subjectively perceived consequences linked with sleep problems [9], such as irritability or difficulty concentrating. Given that insomnia constitutes a significant health hazard, which is often undetected and therefore undertreated, such reliable and economic tools are essential in facilitating early recognition and treatment of sleep complaints [14].

Because insomnia is a subjective disorder, Morin [15] developed the Insomnia Severity Index (ISI) to provide a brief self-report instrument useful to assess peopleā€™s subjective perception of sleep complaints in various populations. Thanks to its brevity (7 items, max. 2Ā min for completion and 1Ā min for scoring), the ISI can be used as a screening measure in clinical practice, allows for the assessment of change following treatment, and is also useful for epidemiological research. ISI scores enable a clinical evaluation with regards to insomnia symptoms. The ISI includes both nighttime and daytime components of insomnia and measures (a) the subjective symptoms and consequences of insomnia and (b) the concerns that result from these difficulties. In part, the ISI takes into account the diagnostic criteria of insomnia as formulated in the DSM-IV (Diagnostic and Statistical Manual of Mental Disorders, 4th Edition) by the American Psychiatric Association [16]. The instrument consists of seven items concerning the severity of sleep-onset (item 1) and sleep maintenance difficulties (including nocturnal and early morning awakening, items 2 and 3 respectively), current sleep satisfaction (item 4), interference of sleep difficulties with daily functioning (item 5), apparentness of impairment due to sleep complaints (item 6), and concerns or distress attributable to sleep complaints (item 7). All items are answered on a 5-point Likert scale ranging from 0 (not at all) to 4 (extremely), with a reference period of the previous 2 weeks. The ISI exists in three different versions: self-administered (patient), administered by a significant other (e.g., spouse, parent), and administered by a clinician [17, 18]. ISI scores range from 0 to 28 and can be interpreted as follows: 0ā€“7ā€‰=ā€‰no clinically significant insomnia, 8ā€“14ā€‰=ā€‰sub-threshold insomnia, 15ā€“21ā€‰=ā€‰clinical insomnia (moderate severity), and 22ā€“28ā€‰=ā€‰clinical insomnia (severe) [17, 19]. The suitability of these cut-offs has been tested both with classical test theory [17, 20] and item response theory [19]. The ISI has been used in clinical research and practice for almost 30Ā years.

The first systematic validation study was published in 2001 by Bastien et al. [17] showing that in a population of 145 patients suffering from clinical sleep disorders, the ISI had good internal consistency and concurrent validity with sleep diaries. As a result of treatment, the changes over time in the ISI were positively correlated with changes in sleep diaries, polysomnography and changes observed by the clinician.

Currently, several studies provide systematic support for the psychometric properties and the validity of the ISI in different populations such as insomnia patients [17, 19], young adults meeting the DSM-IV criteria for primary insomnia versus normal sleepers [20], community samples of adults [19, 21, 22], non-clinical child and adolescent populations [22, 23], elder care community day centre visitors [9], and cancer patients [18].

Regarding psychometric properties, all existing studies show that the ISI has acceptable internal consistency [9, 17, 19, 21ā€“23], with Cronbachā€™s alphas generally exceeding the critical value of .70 [24]. Item-total correlations vary between .32 and .85 [9, 17, 19, 21, 22], with average item-total correlations above .50 [17, 19, 21]. Finally, one study showed that across a 2-week period the test-retest reliability of the ISI total score was satisfactory with a correlation of .79 [23].

With regards to external construct validity, prior research showed that ISI individual items correlated reasonably well with the corresponding variables on sleep diaries for sleep onset latency, waking after sleep onset and early morning awakening, with correlations between .11 and .91 [17, 19, 23]. As expected, significant, albeit weaker associations were found between the individual ISI variables and polysomnographic variables, with correlations ranging from .07 to .45 [17, 19]. Furthermore, moderate-to-strong relationships exist between the ISI and other self-report sleep questionnaires [9, 20, 23]. For instance, in Spanish adolescents, the correlation of the ISI total score with the Pittsburgh Sleep Quality Index (PSQI) was rā€‰=ā€‰.68 [22]. Moreover, a good degree of convergence was found between the patient and clinician versions of the ISI, with correlations between rā€‰=ā€‰.50 and .73 [17, 21, 23]. Additionally, significant correlations were observed between the ISI and other psychological constructs such as depressive symptoms [19, 22], anxiety [19, 22], general fatigue [19, 22], and psychological well-being [18, 19, 23].

The factorial validity of the ISI has been examined in several studies, mostly using exploratory factor analysis. These studies have provided inconsistent findings with solutions suggesting 1 to 3 factors [17ā€“19]. So far, only the Spanish version of the ISI has been validated with confirmatory factor analysis (CFA) [22]. Fernandez-Mendoza et al. [22] compared three alternative models: Model 1 posited that all items load on a single factor (default model) [9, 25]. Model 2 assumed a two-factor structure with two correlated factors (factor 1ā€‰=ā€‰night-time sleep difficulties: factor 2ā€‰=ā€‰daytime impact of insomnia) [9, 18, 26]. Model 3 postulated a three-factor structure with three correlated factors (factor 1ā€‰=ā€‰night-time sleep difficulties; factor 2ā€‰=ā€‰sleep dissatisfaction; factor 3ā€‰=ā€‰impact of insomnia). According to their data, Model 3 achieved the best model fit.

The ISI was developed in English [17, 19]. Subsequently, the ISI has been translated into several languages including French [18, 21], Spanish [22, 25], Chinese [9, 26], Korean [27], Persian [28], Hindi [29], and German [30, 31]. Surprisingly, to date, the psychometric properties of the German version have not been evaluated.

Given this background, the main objective of the present article was to validate the German version of the ISI across three age groups with a specific focus on gender invariance. This study is warranted for at least four reasons: First, the ISI has been widely used in sleep research during the last 15Ā years, including many studies with German-speaking samples [30, 32ā€“35]. Second, German is one of the most frequently spoken languages worldwide with approximately 90 to 95 million first and 10 to 25 million second language speakers [36]. Third, although gender differences regarding the prevalence of insomnia symptoms are consistently reported in the literature [2, 3, 37], none of the previous studies has examined whether the psychometric properties of the ISI apply equally for women and men. Fourth, few validation studies have focused on younger people [22], and none of them has compared the validity of the ISI across different age groups. Nevertheless, such a comparison seems crucial to assure that an instrument is suitable for both younger and older populations.

Based on previous research, four hypotheses were formulated:

  • Our first hypothesis was that female participants would report higher insomnia scores than their male counterparts [2, 3, 37].

  • Our second hypothesis was that the ISI would have adequate homogeneity and internal consistency across all study populations, and both males and females [9, 17, 19, 21ā€“23]. More specifically, we expected inter-item correlationsā€‰ā‰„ā€‰.20, Cronbachā€™s alpha coefficientsā€‰ā‰„ā€‰.70, and item-total correlationsā€‰ā‰„ā€‰.30 [38].

  • Our third hypothesis was that adequate convergent validity would exist in male and female participants across all study populations. That is, we hypothesized that the individual items and the total ISI score would be at least moderately and positively correlated with the corresponding items of the PSQI [17, 19, 23].

  • Our fourth and last hypothesis was that the ISI total score would be at least moderately and positively correlated with indicators of psychological functioning [18, 19, 22, 23].

  • With regard to factorial validity, we did not have a clear-cut hypothesis. Nevertheless, we expected that adequate model fit would be found with either a 1-, 2- or 3-factor model [17, 22]. For the best fitting model, we assumed fair factor loadings on the corresponding factors (ā‰„ .45) [39], and at least weak measurement invariance across genders (see methods of study 1 for more information regarding types of measurement invariance).

Study 1

Methods

Participants and procedures

The sample consisted of 1475 adolescents (M age ā€‰=ā€‰13.4Ā years, SDā€‰=ā€‰1.4; range: 11ā€“16 years; 49Ā % males) who were recruited from five middle schools in the German-speaking, north-western part of Switzerland. Data with this sample have been published previously [40]. Written informed consent was obtained from participants and parents, and the local ethics committee approved the study.

Sleep

To assess insomnia, the participants filled in the 7-item Insomnia Severity Index (ISI) [17], which has been described in detail in the introduction section. To ensure optimal translation, we rigorously followed the procedure set out by Brislin [41]. English items were translated into German, and then back-translated into English by an independent translator (see Additional file 1 for the wording of the items in German). To assess sleep quality, participants filled in a German adaptation [42] of the Pittsburgh Sleep Quality Index (PSQI) [43]. The PSQI includes several indicators to assess both sleep quality and sleep disturbances. The psychometric properties of the instrument are convincing [43]. The German version consists of 11 items, which concern two typical weekdays. The participants answered questions anchored on an 8-point Likert scale concerning sleep-related factors just after waking up in the morning (three items: perceived quality of sleep, restoration, and mood), during the daytime (two items: sleepiness and concentration), and before going to bed (two items: sleepiness and mood). Possible answers ranged from 1 (e.g., very bad sleep quality) to 8 (e.g., very good sleep quality). In addition, sleep onset latency (min), sleep duration and the number of awakenings during nighttime were assessed. Detailed information about bedtime and waking up allowed for the calculation of total sleep duration.

Psychological functioning

Psychological functioning was assessed with the KIDSCREEN-52 [44]. The questionnaire consists of 52 items focusing on 10 different domains of childrenā€™s and adolescentsā€™ psychological functioning (e.g., psychological well-being, parent relation, etc.). Answers were given on a 5-point Likert scale, with the anchor points 1 (not at all) and 5 (extremely/always). The various domains can be aggregated to a global quality of life index, with higher mean scores reflecting higher psychological functioning (Cronbachā€™s alpha for the overall indexā€‰=ā€‰.92).

Statistical analyses

Univariate analyses of variance (ANOVA) were run to test gender differences. Productā€“moment correlations were calculated to examine homogeneity and item-total correlations. Cronbachā€™s alpha coefficients were obtained to test internal consistency. Correlational analyses were used to test convergent validity. Finally, CFA was used to test factorial validity. Although several models were tested in prior research [17, 22], we assumed that all items would load on the same factor. Thus, the 1-factor CFA model was based on seven observed measures and one latent construct. A default model was used, in which all parameters were freely estimated. This default model was then tested against a model, in which all free factor loadings were set equally across both genders. Parameter estimation was conducted using maximum likelihood (ML), and multiple goodness-of-fit indexes were considered to examine how well the theoretical model fitted the empirical data [45]. Measurement invariance across gender of the measurement model was tested via simultaneous multiple group comparison. Normed fit index (NFI) should beā€‰ā‰„ā€‰.95, probability of close fit (PCLOSE)ā€‰ā‰„ā€‰.50, comparative fit index (CFI)ā€‰ā‰„ā€‰.95, Tucker Lewis Index (TLI)ā€‰ā‰„ā€‰.95, and root mean square error of approximation (RMSEA)ā€‰ā‰¤ā€‰.05. We first examined the most parsimonious 1-factor model. In case of unsatisfactory model fit, we continued with the more complex 2- and 3-factor models. According to Comrey and Lee [39], standardized factor loadings ofā€‰ā‰„ā€‰.71 should be interpreted as excellent, ā‰„ .63 as very good, ā‰„ .55 as good, ā‰„ .45 as fair, andā€‰>ā€‰.32 as poor. CFA are performed with AMOSĀ® 22 (IBM Corporation, Armonk NY, USA), all other analyses with SPSSĀ® 22 (IBM Corporation, Armonk NY, USA). To test measurement invariance across gender, we compared the default model against a model which assumed configural (same pattern of fixed and free factor loadings across groups), weak (invariant factor loadings across groups), strong (invariant factor loadings and intercepts across groups) and strict measurement invariance (invariant factor loadings, intercepts, and unique factor variances across groups) [46].

Results

As shown in TableĀ 1, the ISI mean score was 6.67 (SDā€‰=ā€‰4.39). In the total sample, 65Ā % (nā€‰=ā€‰963) of the participants reported no insomnia, 29Ā % (nā€‰=ā€‰431) sub-threshold insomnia, 4.7Ā % (nā€‰=ā€‰69) clinical insomnia of moderate severity, and 1Ā % (nā€‰=ā€‰12) severe clinical insomnia. TableĀ 1 points out that girls (Mā€‰=ā€‰7.23, SDā€‰=ā€‰4.46) reported more severe insomnia symptoms than boys (Mā€‰=ā€‰6.08, SDā€‰=ā€‰4.24). Similarly, the Chi2-test showed that girls were overrepresented in the group with sub-threshold insomnia (32Ā % vs. 26Ā %) and moderate clinical insomnia (6Ā % vs. 3Ā %), whereas they were underrepresented in the group classified as having no insomnia (61Ā % vs. 70Ā %).

Table 1 Descriptive statistics of the total sample, test of gender differences, bivariate correlations between individual ISI items, and item-total correlations among male and female adolescents

The majority of inter-item correlations exceeded the critical value of .20 in boys and girls (TableĀ 1). Similarly, most item-total correlations were satisfactory, with an average correlation of .48. The lowest inter-item and item-total correlations were found for item 6 (r it ā€‰=ā€‰.28 to .32). The Cronbachā€™s alpha was .76 for the total sample, boys and girls.

Regarding the associations between the ISI and PSQI items, significant correlations were found between item 1 and sleep onset latency, and item 2 and number of awakenings (TableĀ 2). Contrary to our expectation, item 3 was not associated with sleep duration. Furthermore, a strong correlation was found between item 4 and sleep quality. Finally, significant correlations were found for items 5ā€“7 with feeling restored and mood after awakening in the morning, as well as daytime sleepiness and concentration. The correlations between the ISI total score and the PSQI items show similar associations between the two instruments for boys and girls (TableĀ 2). The moderate (negative) correlation between the ISI and psychological functioning provides further support for convergent validity of the ISI.

Table 2 Bivariate correlations between the ISI, the PSQI and psychological functioning among male and female adolescents

With regard to factorial validity, as shown in TableĀ 3, the model fit of the initial 1-factor model was excellent. Furthermore, TableĀ 3 provides support for configural and weak measurement invariance (invariant factor loadings) across genders, p(Ī”Ļ‡2)ā€‰=ā€‰.28. Most of the factor loadings were fair to excellent, except for items 5 and 6 with loadings ranging from .17 to .40. FigureĀ 1 provides the measurement coefficients of the hypothesized 1-factor model (after testing for configural and weak invariance), separately for boys and girls.

Table 3 Goodness-of-fit indices and model comparison
Fig. 1
figure 1

Factor Loadings For Confirmatory Factor Analysis for Males (First Coefficient) and Females (Second Coefficient), Separately for Study 1, 2 and 3

Study 2

Methods

Participants and procedures

Sample 2 consisted of 862 students (Mageā€‰=ā€‰24.7, SDā€‰=ā€‰5.9) from the German-speaking, north-western part of Switzerland (223 men, 639 women), who were recruited from the University of Basel (nā€‰=ā€‰556) and from the Northwestern University of Applied Sciences (nā€‰=ā€‰306). Data with this sample have been published previously [31, 47, 48]. Participants provided informed consent and the local ethics committee approved the study.

Sleep

As in study 1, sleep complaints were assessed with the ISI, quality of sleep with the 11-item German adaptation of the PSQI.

Psychological functioning

Psychological functioning was assessed via depressive symptoms, using the Depression Scale (DS) [49]. This scale consists of 16 items ranging from 1 (not at all true) to 4 (definitely true) and concerns decreased mood, lack of satisfying social and leisure activities, thoughts about suicide, and hopelessness. The internal consistency of the DS proved to be good in the present sample (Cronbachā€™s alphaā€‰=ā€‰.86).

Statistical analyses

The same statistical procedures as those from study 1 were used.

Results

The ISI mean score was 6.56 (SDā€‰=ā€‰4.31) in the total sample. Moreover, 68Ā % (nā€‰=ā€‰585) were categorized as having no insomnia, 26Ā % (nā€‰=ā€‰224) as having sub-threshold insomnia, 6Ā % (nā€‰=ā€‰49) as having moderate clinical insomnia, and 1Ā % (nā€‰=ā€‰4) as having severe clinical insomnia. The ANOVA (TableĀ 4) shows that women (Mā€‰=ā€‰6.80, SDā€‰=ā€‰4.37) reported more insomnia symptoms than men (Mā€‰=ā€‰5.91, SDā€‰=ā€‰4.13). Gender differences were found for items 1 and 2, but not for the other items. The Chi2-test did not detect differences with regard to insomnia categories between men and women.

Table 4 Descriptive statistics of the total sample, test of gender differences, bivariate correlations between individual ISI items, and item-total correlations among male and female young adults

As shown in TableĀ 4, the inter-item correlations were mostly above the critical value of .20. Acceptable item-total correlations were also found for men and women (with mean correlations of .51 for men and .49 for women). The Cronbachā€™s alpha was .77 in the total sample, .78 for men and .76 for women.

With regard to the ISI-PSQI correlations, significant associations occurred for item 1 and sleep onset latency, and item 2 and number of awakenings (TableĀ 5). As in study 1, no significant relationship was found to exist between item 3 and sleep duration. Furthermore, a strong correlation was identified between item 4 and sleep quality. Significant correlations also existed between items 5 and 7 and feeling restored in the morning, as well as daytime sleepiness and concentration. The correlations for item 6 pointed into the same direction, but were generally weak. The correlations between the PSQI items and the ISI revealed similar relationships for men and women. Finally, TableĀ 5 revealed that insomnia is strongly associated with depressive symptoms, independent of participantsā€™ gender.

Table 5 Bivariate Correlations Between the ISI, the PSQI and Psychological Functioning among Male and Female Young Adults

The findings of the CFA confirm that the 1-factor model fits well with the empirical data (TableĀ 3). Strong measurement invariance (invariant factor loadings and intercepts) across genders was supported. Most factor loadings were fair to excellent. However, the factor loadings of item 5 (.29 to .31) and 6 (.11) were poor (Fig.Ā 1).

Study 3

Methods

Participants and procedures

Sample 3 consisted of 533 employees of the police force and emergency response service corps in the German-speaking, north-western part of Switzerland (M age ā€‰=ā€‰41.2, SDā€‰=ā€‰9.8Ā years, 411 men and 122 women), who responded to a written questionnaire (45Ā % return rate). Data with this sample have been published previously [50, 51]. Participants gave informed consent and the study was performed in accordance with the ethical standards laid down in the Declaration of Helsinki.

Sleep

The same instruments as in study 1 and 2 were used to measure sleep complaints (ISI) and quality of sleep (PSQI).

Psychological functioning

To assess psychological functioning, participants completed the 12-Item Short Form Health Survey (SF-12) [52]. The composite score for the psychological subscale was obtained by weighting each item as described in the SF-12 manual. Higher scores reflect increased health functioning.

Statistical analyses

The same statistical procedures were used as in study 1.

Results

As shown in TableĀ 6, the ISI mean score was 6.98 (SDā€‰=ā€‰4.96) in the total sample. Moreover, 62Ā % (nā€‰=ā€‰331) of the participants had no insomnia, 30Ā % (nā€‰=ā€‰160) had sub-threshold insomnia, 7Ā % (nā€‰=ā€‰35) had clinical insomnia of moderate severity, whereas 1Ā % (nā€‰=ā€‰7) had severe clinical insomnia. Unlike study 1 and 2, women (Mā€‰=ā€‰7.00, SDā€‰=ā€‰5.20) and men (Mā€‰=ā€‰6.97, SDā€‰=ā€‰4.89) did not differ with regard to any of the insomnia measures (TableĀ 7).

Table 6 Descriptive Statistics of the Total Sample, Test of Gender Differences, Bivariate Correlations Between Individual ISI Items, and Item-Total Correlations Among Male and Female Adult Workers
Table 7 Bivariate Correlations Between the ISI, the PSQI and Psychological Functioning among Male and Female Adult Workers

The majority of inter-item correlations exceeded the critical value of .20 for most pairs of items, independent of participantsā€™ gender. Similarly, most item-total correlations were satisfactory (with average correlations of .55 for men and .56 for women). The Cronbachā€™s alpha was .81 in the total sample, .81 for men and .82 for women.

With regard to the associations between the ISI and PSQI items, significant correlations existed between item 1 and sleep onset latency, item 2 and number of awakenings, and item 3 and sleep duration (TableĀ 7). Furthermore, a strong correlation was found between item 4 and sleep quality. Significant correlations also existed between items 5 and 7 and feeling restored and mood after awakening in the morning, as well as daytime sleepiness and concentration. The correlations for item 6 pointed into the same direction, but were generally weak. Similar associations were found among men and women with regard to the correlations between the PSQI items and the ISI total score. The significant negative correlations between the ISI and the SF12 psychological functioning scale further support the convergent validity of the instrument (TableĀ 7).

The CFA corroborated that a 1-factor model had excellent model fit. Furthermore, strict measurement invariance (invariant factor loadings, intercepts, and unique factor variances across groups) was supported across genders (TableĀ 3). Five of seven factor loadings were very good or excellent. Nevertheless, the factor loadings of items 5 and 6 were poor (between .13 and .26; see Fig.Ā 1).

Discussion

The key findings of the present study are that the German version of the ISI has generally acceptable psychometric properties and sufficient concurrent validity to be recommended as a brief screening measure in both adolescents and adults. Moreover, the factor structure of the ISI proved to be invariant across gender.

Four hypotheses were formulated and each of these will now be discussed in turn.

Our first hypothesis was that female participants would report higher insomnia scores than their male counterparts. This hypothesis was supported in adolescents and young adults, which is consistent with the majority of previous studies [2, 3]. Contrary to our hypothesis, no gender differences were found in police and emergency service response officers. A meta-analysis of 29 studies showed that a female predisposition to insomnia is consistent and progressive across age [53]. Thus, increasing age does not provide a plausible explanation. Most likely, this unexpected finding can be attributed to the fact that in study 3 men were overrepresented in shift workers in this specific professional group [50], which might contribute to increased insomnia mean scores among male participants [54]. Further, it is also conceivable that the job of police officer per se led to a selection bias.

Our second hypothesis was that the ISI would have adequate homogeneity and internal consistency across all study populations, and both men and women [9, 17, 19, 21ā€“23]. This hypothesis was generally supported. First, all Cronbachā€™s alpha coefficients wereā€‰ā‰„ā€‰.70 for both men and women [38]. Second, across all three samples, the majority of inter-item correlations wereā€‰ā‰„ā€‰.20, and most item-total correlations wereā€‰ā‰„ā€‰.30. The lowest coefficients were consistently shown for item 6. This is congruent with previous research, and most likely due to the fact that this item refers to the opinion of others about oneā€™s own sleep. Thus, information about what others think might not be as subjectively relevant as individual perceptions about oneā€™s own sleep. Not surprisingly, therefore, item 6 also had somewhat suboptimal factor loadings in the CFA, both in male and female participants. Nevertheless, we decided not to exclude this item since the low factor loading did not negatively affect the general model fit, and because exclusion of item 6 would not have resulted in substantial improvements in the Cronbachā€™s alpha coefficient.

In our third hypothesis, we assumed that adequate convergent validity would exist for male and female participants throughout all study populations. This hypothesis was fully supported. In line with previous research, our findings show that the individual items and the total ISI score correlate at least moderately and positively with the corresponding PSQI items [17, 19, 23]. Moreover, our data corroborate previous research showing that the ISI is associated with impaired psychological functioning [18, 19, 22, 23].

With regard to factorial validity, the findings of our studies point out that a 1-factor model provides an excellent model fit across all age groups. We acknowledge that the 2- and 3-factor models also had very good model fit (data not shown). For several reasons, however, the 1-factor model seems the most suitable one: First, it is generally recommended to use the most parsimonious model if goodness-of-fit indices are satisfied by several alternative models [55]. Second, the 2- and 3-factor models showed very high inter-factor correlations with coefficients ranging between .60 and .98. This reveals a great overlap between the latent factors, which might pose problems associated with multicollinearity when using the separate factors as independent predictors. Third, the loadings of item 5 and 6 on the latent factor did not improve substantially in the multifactorial models. Fourth, in the 3-factor model, one factor consists of one item only (factor 2: satisfaction), which precludes a test of internal consistency. Furthermore, this single item factor proved to have substantial cross-loadings on the other two factors in previous research [22]. Fifth, cut-offs scores to establish the severity of insomnia only exist for the total score [19].

Finally, weak-to-strict measurement invariance across all age groups was supported. This is an important finding because Widaman et al. [46] emphasized that if participantsā€™ answers vary so much with age that significant differences emerge in the factor structure of an instrument, or that relevant ceiling or floor effects occur at different ages, the measuring devices must change. The present analyses suggest that the ISI is equally suitable to detect insomnia symptoms in adolescents, young adults and adult workers.

The findings of the present study need to be interpreted in light of several limitations: First, the findings are based on cross-sectional data. Thus, we were unable to test predictive validity and the test-retest reliability. Nevertheless, a previous study with a German-speaking sample of high school students showed that the ISI score improved after 3 weeks of daily morning running [56]. Moreover, we were not able to test measurement invariance across time within the same individuals [46]. Second, the findings are entirely based on self-reported data. Thus, we did not test the degree to which the ISI items correlated with objective sleep measures. Nevertheless, the German version of the ISI proved to be weakly but significantly associated with 1-channel EEG measures in previous studies [34], with a magnitude of relationships similar to that reported in the international literature [17, 19]. Third, all three studies used non-clinical populations, which precludes the establishment of the discriminant validity of the ISI. Nevertheless, previous research showed that the ISI discriminates well between patients with insomnia and controls without sleep disorders [19ā€“21, 23], and offers a good balance between sensitivity (likelihood of detecting insomnia in a subject from the insomnia group) and specificity (likelihood of rejecting insomnia in a subject from the control group) [20ā€“22]. Fourth, we acknowledge that a clinical evaluation should be seen as the gold standard for the detection of sleep difficulties [19]. However, a clinical evaluation is time-consuming, which may discourage general practitioners from systematically inquiring about sleep in their patients [19]. Thus, the ISI provides a time- and cost-effective alternative, which seems feasible for general practitioners and for public health screening purposes.

Conclusions and practical relevance

While the ISI has been widely used in German-speaking countries, this study is the first to provide empirical evidence that the German version of the instrument has good psychometric properties and satisfactory convergent and factorial validity across various age groups and both men and women. Compared to other instruments which identify and quantify sleep disturbances [43, 57], the ISI is brief and cheap, easy to administer and to score, and corresponds well with the diagnostic criteria for insomnia defined in the DSM-IV. Thus, the tool provides relevant information for diagnosis and treatment planning and allows assessment of the clinical significance of the complaints by providing cut-off scores.

Abbreviations

ANOVA, analysis of variance; CFA, confirmatory factor analysis; CFI, comparative fit inex; DS, depression scale; DSM-IV, diagnostic and statistical manual of mental disorders; ISI, insomnia severity index; ML, maximum likelihood; NFI, normed fit index; PClose, probability of close fit; PSQI, pittsburgh sleep quality index (psqi); RMSEA, root mean square error of approximation; SF-12, 12-item short form health survey; TLI, Tucker Lewis Index

References

  1. Roth T. Insomnia: Defintion, prevalence, etiology, and consequences. J Clin Sleep Med. 2007;15:S7ā€“10.

    Google ScholarĀ 

  2. Ohayon MM, Paiva T. Global sleep dissatisfaction for the assessment of insomnia severity in the general population of Portugal. Sleep Med. 2005;6:435ā€“41.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  3. Buysse DJ, Angst J, Gamma A, Ajdacic V, Eich D, Rossler W. Prevalence, course, and comorbidity of insomnia and depression in young adults. Sleep. 2008;31:473ā€“80.

    ArticleĀ  PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  4. Banks S, Dinges DF. Behavioral and physiological consequences of sleep restriction. J Clin Sleep Med. 2007;3:519ā€“28.

    PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  5. Stickgold R. Sleep-dependent memory consolidation. Nature. 2005;437:1272ā€“8.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  6. Curcio G, Ferrara L, De Gennaro M. Sleep loss, learning capacity and academic performance. Sleep Med Rev. 2006;10:323ā€“37.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  7. Hatzinger M, Brand S, Perren S, Stadelmann S, Von Wyl A, Von Klitzing K, Holsboer-Trachsler E. Electroencephalographic sleep profiles and hypothalamic-pituitary-adrenocortical (HPA) activity in kindergarten children: early indication of poor sleep quality associated with increased cor-tisol secretion. J Psychiatr Res. 2008;42:352ā€“543.

    ArticleĀ  Google ScholarĀ 

  8. Roberts RE, Roberts CR, Duong HT. Chronic insomnia and its negative consequences for health and functioning of adolescents: A 12-month prospective study. J Adolesc Health. 2008;42:294ā€“302.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  9. Yu DS. Insomnia Severity Index: Psychometric properties with Chines community-dwelling older people. J Adv Nurs. 2010;66:2350ā€“9.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  10. Taylor DJ. Insomnia and depression. Sleep. 2008;31:447ā€“8.

    PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  11. El-Anzi FO. Insomnia in relation to depression and somatic symptoms. Psychol Rep. 2006;99:171ā€“5.

    PubMedĀ  Google ScholarĀ 

  12. Lang C, Kalak N, Brand S, Holsboer-Trachsler E, PĆ¼hse U, Gerber M. The relationship between physical activity and sleep from mid adolescence to early adulthood. A systematic review of methodological approaches and meta-analysis. Sleep Med Rev. 2015;58:28ā€“41.

    Google ScholarĀ 

  13. Monk TH, Buysse DJ, Rose DJ, Hall JA, Kupfer DJ. The sleep of healthy people ā€“ A diary study. Chronobio Int. 2000;17:49ā€“60.

    ArticleĀ  CASĀ  Google ScholarĀ 

  14. Morin CM, Leblanc M, BĆ©langer L, Ivers H, MĆ©rette C, Savard J. Prevalence of insomnia and its treatment in Canada. Can J Psychiatry. 2011;56:540ā€“8.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  15. Morin CM. Insomnia: Psychological assessment and management. New York: Guilford; 1993.

    Google ScholarĀ 

  16. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR. Washington: American Psychiatric Publishing; 2000.

    Google ScholarĀ 

  17. Bastien CH, ValliĆØres A, Morin CM. Validation of the Insomnia Severity Index (ISI) as an outcome measure for insomnia research. Sleep Med. 2001;2:297ā€“307.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  18. Savard MH, Savard J, Simard S, Ivers H. Empirical validation of the Insomnia Severity Index in cancer patients. Psychooncology. 2005;14:429ā€“41.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  19. Morin CM, Belleville G, Belanger L, Ivers H. The Insomnia Severity Index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. 2011;34:601ā€“8.

    PubMedĀ  PubMed CentralĀ  Google ScholarĀ 

  20. Smith S, Trinder J. Detecting insomnia: Comparison of four self-report measures of sleep in a young adult population. J Sleep Res. 2001;10:229ā€“35.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  21. Gagnon C, BĆ©langer L, Ivers H, Morin CM. Validation of the Insomnia Severity Index in primary care. J Am Board Fam Med. 2013;26:701ā€“10.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  22. Fernandez-Mendoza J, Rodriguez-Munoz A, Vela-Bueno A, Olevarrieta-Bernardino S, Calhoun SL, Bixler EO, Vgontzas AN. The Spanish version of the Insomnia Severity Index: A confirmatory factor analysis. Sleep Med. 2012;13:207ā€“10.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  23. Chung JW, Chung LM, Chen B. The impact of lifestyle on the physical fitness of primary school children. J Clin Nurs. 2009;18:1002ā€“9.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  24. Norton K, Norton L, Sadgrove D. Position statement on physical activity and exercise intensity. J Sci Med Sport. 2010;13:496ā€“502.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  25. Sierra JC, GuillĆ©n-Serrano V, Santos-Iglesias P. Insomnia Severity Index: Some indicators about its reliability and validity on an older adult sample. Rev Neurology. 2008;47:566ā€“70.

    CASĀ  Google ScholarĀ 

  26. Chung KF, Kan KK, Yeung WF. Assessing insomnia in adolescents: Comparison of Insomnia SEverity Index, Athens Insomnia Scale and Sleep Quality Index. Sleep Med. 2011;12:463ā€“70.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  27. Cho YW, Song ML, Morin CM. Validation of a Korean version of the Insomnia Severity Index. J Clin Neurology. 2014;10:210ā€“5.

    ArticleĀ  Google ScholarĀ 

  28. Yazdi Z, Haghighi KS, Zohal MA, Elmizadeh K. Validity and reliability of the Iranian version of the Insomnia Severity Index. Malaysian J Med Sci. 2012;19:31ā€“6.

    Google ScholarĀ 

  29. Lahan V, Gupta R. Translation and validation of the Insomnia Severity Index in Hindi language. Ind J Psychol Med. 2011;33:172ā€“6.

    ArticleĀ  Google ScholarĀ 

  30. Brand S, Beck J, Gerber M, Hatzinger M. Football is good for your sleep. Favorable sleep patterns and psychological functioning of adolescent male intense football players compared to controls. J Health Psychol. 2009;14:1144ā€“55.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  31. Brand S, Gerber M, PĆ¼hse U, Holsboer-Trachsler E. Depression, hypomania and dysfunctional cognitions as mediators between stress and insomnia: The best advice is not always found on the pillow! Int J Stress Management. 2010;17:114ā€“34. doi:10.1037/a0019090.

    ArticleĀ  Google ScholarĀ 

  32. Brand S, Beck J, Gerber M, Hatzinger M, Holsboer-Trachsler E. Evidence of favorable sleep-EEG patterns in adolescent male vigorous football players compared to controls. W J Biol Psychiatry. 2009;11:465ā€“75.

    ArticleĀ  Google ScholarĀ 

  33. Kalak N, Gerber M, Kirov R, Mikoteit T, Puehse U, Holsboer-Trachsler E, Brand S. The relation of objective sleep patterns, depressive symptoms, and sleep disturbances in adolescent children and their parents: A sleep-EEG study with 47 families. J Psychiatr Res. 2012;46:1374ā€“82.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  34. Lang C, Brand S, Feldmeth AK, Holsboer-Trachsler E, PĆ¼hse U, Gerber M. Increased self-reported and objectively assessed physical activity predict sleep quality among adolescents. Physiol Behav. 2013;120:46ā€“53.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  35. Gerber M, Brand S, Herrmann C, Colledge F, Holsboer-Trachsler E, PĆ¼hse U. Increased objectively assessed vigorous-intensity exercise is associated with reduced stress, increased mental health and good objective and subjective sleep in young adults. Physiol Behav. 2014;135:17ā€“24.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

  36. Ammon U. Die Stellung der deutschen Sprache in der Welt. Berlin: de Gruyter; 2014.

    BookĀ  Google ScholarĀ 

  37. Alexander JL, Dennerstein L, Kotz K, Richardson GS. Women, anxiety and mood: a review of nomenclature, comorbidity and epidemiology. Expert Rev Neurother. 2007;7:S45ā€“58.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  38. Nunnally J, Bernstein B. Psychometric theory. New York: McGraw-Hill; 1994.

    Google ScholarĀ 

  39. Comrey AL, Lee HB. A first course in factor analysis. Hillsdale: Erlbaum; 1992.

    Google ScholarĀ 

  40. Brand S, Kalak N, Gerber M, Clough PJ, Lemola S, PĆ¼hse U, et al. During early and mid-adolescence, greater mental toughness is related to increased sleep quality and quality of life. J Health Psychol. 2014.

  41. Brislin RW. The wording and translation of research instrument. In: Lonner WJ, Berry JW, editors. Field methods in cross-cultural research. Beverly Hills: Sage; 1986. p. 137ā€“64.

    Google ScholarĀ 

  42. Backhaus J, Riemann D. Schlafstƶrungen bewƤltigen [Coping with sleep disorders]. Weinheim: Beltz Psychologie Verlags Union; 1996.

    Google ScholarĀ 

  43. Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: New instrument for psychiatric practice and research. Psychiatr Rev. 1989;28:193ā€“213.

    CASĀ  Google ScholarĀ 

  44. Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, et al. The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value Health. 2008;11.

  45. McDonald RP, Ho RM. Principles and practice in reporting structural equation analyses. Psychol Methods. 2002;7:65ā€“9.

    ArticleĀ  Google ScholarĀ 

  46. Widaman KF, Ferrer E, Conger RD. Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Dev. 2010;4:10ā€“8.

    ArticleĀ  Google ScholarĀ 

  47. Brand S, Gerber M, PĆ¼hse U, Holsboer-Trachsler E. The relationship between sleep and pain among a non-clinical sample of young adults. Eur Arch Psychiatry and Clin Neurosci. 2010;260:543ā€“51.

    ArticleĀ  Google ScholarĀ 

  48. Gerber M, Brand S, Holsboer-Trachsler E, PĆ¼hse U. Fitness and exercise as correlates of sleep complaints. Is it all in our minds? Med Sci Sports Exerc. 2010;43:893ā€“901.

    ArticleĀ  Google ScholarĀ 

  49. Von Zerssen D. DepressivitƤts-Skala [Depression scale]. Gƶttingen: Hogrefe; 1976.

    Google ScholarĀ 

  50. Gerber M, Hartmann T, Brand S, Holsboer-Trachsler E, PĆ¼hse U. The relationship between shift work, perceived stress, sleep and health in Swiss police officers. J Crim Just. 2010;38:1167ā€“75.

    ArticleĀ  Google ScholarĀ 

  51. Gerber M, Kellmann M, Elliot C, Hartmann T, Brand S, Holsboer-Trachsler E, PĆ¼hse U. Perceived fitness protects against stress-based mental health impairments among police of-ficers who report good sleep. J Occ Health. 2013;55:376ā€“84.

    ArticleĀ  Google ScholarĀ 

  52. Bullinger M, Kirchberger I. SF-36 Fragebogen zum Gesundheitszustand. Gƶttingen: Hogrefe; 2011.

    Google ScholarĀ 

  53. Zhang B, Wing Y-K. Sex differences in insomnia: A meta-analysis. Sleep. 2006;29:85ā€“93.

    PubMedĀ  Google ScholarĀ 

  54. Akerstedt T. Shift work and disturbed sleep/wakefulness. Occ Med. 2003;53:89ā€“94.

    ArticleĀ  Google ScholarĀ 

  55. Byrne BM. Structural equation modeling with AMOS. Basic concepts, applications, and programming. New York: Taylor & Francis; 2010.

    Google ScholarĀ 

  56. Kalak N, Gerber M, Kirov R, Mikoteit T, Yordanova J, Puhse U, Holsboer-Trachsler E, Brand S. Daily morning running for 3Ā weeks improved sleep and psychological functioning in healthy adolescents compared with controls. J Adolesc Health. 2012;51:615ā€“22.

    ArticleĀ  PubMedĀ  Google ScholarĀ 

  57. Soldatos CR, Dieos DG, Paparrigopoulos TJ. Athens Insomnia Scale: Validation of an instrument based on ICD-10 criteria. J Psychosom Res. 2000;48:555ā€“60.

    ArticleĀ  CASĀ  PubMedĀ  Google ScholarĀ 

Download references

Acknowledgements

None.

Funding

Study 1 was conducted without external funding. Study 2 was financially supported by the Freiwillige Akademische Gesellschaft (FAG) Basel, Switzerland. Study 3 was financially supported by the police management of the Basel police force. The sponsors had no further role in study design, collection, analysis, interpretation of data, writing of this report, and in the decision to submit this paper for publication. The authors alone are responsible for the content and writing of the paper. All authors have read and approved the manuscript.

Availability of data and materials

Data cannot be shared because in the protocol submitted to the Ethics Committee of Northwestern and Central Switzerland, the authors confirmed that only researchers of the Department of Sport, Exercise and Health, University of Basel, Basel, Switzerland, and the Center for Affective, Stress and Sleep Disorders, Psychiatric Clinics of the University of Basel, Basel, Switzerland, will have access to the raw data.

Authorsā€™ contributions

MG and SB contributed to the conception and design of all studies, the analysis and interpretation of the data. MG drafted the manuscript. CL contributed to the conception and design of study 2, the analysis and interpretation of the data and to the revision of the drafted manuscript. CL, SL, FC, NK, EHT, and UP contributed to the analysis and interpretation of the data and to the revision of the drafted manuscript. All authors read and approved the final manuscript.

Authorsā€™ information

None.

Competing interest

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

All participants provided informed written consent. Studies 1 and 2 were approved by the Ethikkommission Nordwest- und Zentralschweiz (Ethics Committee of Northwestern and Central Switzerland). No ethical approval was obtained for study 3. However, study 3 was conducted in line with the principles of the Declaration of Helsinki. That is, participants received general information about the purpose of the study (but not about specific hypotheses), about the voluntary basis of their participation, and about the confidentiality of their responses. All questionnaires were anonymous, and the researchers ensured that no inferences about the identity of participating individuals can be made upon publication of the data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Markus Gerber.

Additional file

Additional file 1:

Validation of the German Version of the Insomnia Severity Index_Supplementary Online Material. Insomnia Severity Index ā€“ Deutsche Ɯbersetzung (German translation). This file provides the German translation of the Insomnia Severity Index, as well as a guide for (a) calculating an overall index and (b) interpreting the overall score. (DOCX 81 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gerber, M., Lang, C., Lemola, S. et al. Validation of the German version of the insomnia severity index in adolescents, young adults and adult workers: results from three cross-sectional studies. BMC Psychiatry 16, 174 (2016). https://doi.org/10.1186/s12888-016-0876-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-016-0876-8

Keywords