- Research article
- Open Access
- Open Peer Review
Psychometric properties and clinical utility of the Scale for Suicidal Ideation (SSI) in adolescents
© Holi et al; licensee BioMed Central Ltd. 2005
- Received: 26 November 2004
- Accepted: 03 February 2005
- Published: 03 February 2005
Accurate assessment of suicidality is of major importance in both clinical and research settings. The Scale for Suicidal Ideation (SSI) is a well-established clinician-rating scale but its suitability to adolescents has not been studied. The aim of this study was to evaluate the reliability and validity, and to test an appropriate cutoff threshold for the SSI in a depressed adolescent outpatient population and controls.
218 adolescent psychiatric outpatient clinic patients suffering from depressive disorders and 200 age- and sex-matched school-attending controls were evaluated by the SSI for presence and severity of suicidal ideation. Internal consistency, discriminative-, concurrent-, and construct validity as well as the screening properties of the SSI were evaluated.
Cronbach's α for the whole SSI was 0.95. The SSI total score differentiated patients and controls, and increased statistically significantly in classes with increasing severity of suicidality derived from the suicidality items of the K-SADS-PL diagnostic interview. Varimax-rotated principal component analysis of the SSI items yielded three theoretically coherent factors suggesting construct validity. Area under the receiver operating characteristic (ROC) curve was 0.84 for the whole sample and 0.80 for the patient sample. The optimal cutoff threshold for the SSI total score was 3/4 yielding sensitivity of 75% and specificity of 88.9% in this population.
SSI appears to be a reliable and a valid measure of suicidal ideation for depressed adolescents.
- Suicidal Ideation
- Concurrent Validity
- Cutoff Threshold
- Outpatient Sample
- Inpatient Child
Accurate assessment of suicidality is of major importance in both clinical and research settings. Adolescent suicide occurs usually in the context of an active, often treatable, but unrecognized or untreated mental illness [1–3]. The increase in the antidepressant treatment of adolescents in the USA  may partly explain the decline in the incidence of youthful suicide , though recently some reports have connected SSRI-treatment in adolescents to an increase in suicidality .
Suicide attempts are complex acts for which no single set of clinical features can be expected to be a good predictor . Suicidal ideation, self-harming, suicide attempts and completed suicides are different forms of suicidality. Although the domain of suicidal behavior probably is multidimensional , a continuum from suicide ideation to suicide attempts has been reported in youthful clinical populations [9, 10]. Thus, although most patients with suicidal ideation do not attempt suicide, identification and assessment of severity of suicidal ideation is of major importance.
The Scale for Suicidal Ideation (SSI)  was designed to measure the intensity, pervasiveness, and characteristics of suicidal ideation in adults. It also aims to assess the risk of later suicide attempt in individuals who have thoughts, plans, and wishes to commit suicide . It is a well-established clinician-rating scale and is presented in a semi-structured interview format.
The psychometric properties of the SSI have been evaluated in adult population and in inpatient children. Both in a sample of adult psychiatric inpatients and in a sample of inpatient children the internal consistency of the scale was good [11, 13]. SSI reportedly has three dimensions , which have been only partly replicated in some factor analytical studies [e.g. [13, 14]]. SSI has been found to converge with scales measuring related constructs e.g. hopelessness and depression in adults, and hopelessness, depression and self-harm in children [11, 13].
The predictive validity of the SSI has been studied in a sample of hospitalised patients, where the SSI scores of those who committed suicide were not significantly higher than the scores of inpatients that did not . In a sample of 3701 adult outpatients those who scored over a SSI threshold value had 5.42 times higher odds of committing suicide than those who scored under . The threshold value was derived from a receiver operating characteristic (ROC) analysis that yielded optimal threshold of 1/2 for predicting future suicide. In the same study, SSI-scores inquiring the worst point in life (SSI-W) yielded an odds ratio of 13.84 for predicting suicide. A recent study that inquired retrospectively records of suicide victims to find communications that fit the SSI-items found no suicide-predicting power for the instrument .
Some instruments have evolved from the SSI, for example the Modified scale for suicidal ideation (MSSI)  that was designed to suit paraprofessionals and the Beck scale for suicidal ideation (BSS)  that is a self-report scale.
The SSI has been used widely in adult psychiatric populations [e.g. [20, 21]], but its psychometric properties have not been evaluated in adolescents. According to a recent comprehensive review "despite its potential utility, the SSI's suitability to adolescents... remains to be elucidated" . Rating scales should be validated in each patient population in which they are used. The aim of this study was to evaluate the reliability and validity of the SSI and test an appropriate cutoff threshold for clinically significant suicidal ideation in an adolescent population.
The study population consisted of two samples; a psychiatric outpatient sample of 218, and an age- and sex-matched control sample of 200 school-attending adolescents. The outpatients suffered from depressive mood disorder, were of ages 13 through 19, and took part in the Adolescent Depression Study (ADS). They were recruited between 1.2.1998 and 31.12.2001 from a consecutive sample of patients attending the outpatient clinics of the Department of Adolescent Psychiatry of Peijas Medical Health Care District covering approximately 210,000 inhabitants and comprising the cities of Vantaa and Kerava in the Helsinki metropolitan area, southern Finland.
Of the eligible (appropriate age, knowledge of Finnish language and adequate cognitive capacity) 660 outpatients, 624 (94.5%) were screened during their first consultation visit by the Beck Depression Inventory (BDI)  and the General Health Questionnaire-36 (GHQ-36) [24, 25]. Those 373 (59.8%) with scores of 10 or more and 5 or more, respectively, were considered screen positives, and were asked to participate in the study. 118 (31.6%) outpatients refused and 34 (9.1%) dropped out at this stage. 221 (33.5%) remaining outpatients were evaluated by a diagnostic interview (K-SADS-PL)  and those 218 (33.0%) with a current depressive mood disorder were included in the study.
The control sample was drawn from the enrollment lists in four schools in the corresponding geographical area. It was a random sample of age- and sex-matched students equating the distribution of the educational level of the outpatients.
1) The Scale for Suicide Ideation (SSI) is a clinician-rating scale and is presented in a semi-structured interview format . It consists of 19 items that evaluate three dimensions of suicide ideation: active suicidal desire, specific plans for suicide, and passive suicidal desire. Each item is rated on a 3-point scale from 0 to 2. The higher the total score, the greater the severity of suicide ideation. In some previous studies on adult suicidality a score of 6 or more has been used as a cutoff threshold for clinically significant suicidal ideation [e.g. ]. The psychometric properties of the SSI have been evaluated for adult psychiatric patient population; the internal consistency of the scale was found to be good (α = 0.89), and factor analysis yielded the three above-mentioned dimensions . Among inpatient children rated by trained raters the factors could not be replicated; only two factors ("active suicidal desire" and a mixture of "active and passive desire") existed with miscellaneous items left over . Nine trained raters did the SSI rating in our study.
2) The Schedule for Affective Disorders and Schizophrenia for School-Aged Children-Present and Lifetime (K-SADS-PL)  is a widely used semi-structured diagnostic interview. Suicidal behavior was determined using four questions from the screening-section of the K-SADS-PL diagnostic interview: item-1 suicidal thoughts ("1" = none, "2" = occasional, "3" = frequent), item-2 suicide attempts and their seriousness ("1" = none, "2" = ambivalent, "3" = serious) and item-3 suicide attempts and their lethality ("1" = none, "2" = not life-threatening, "3" = life-threatening). Self-harming behavior was asked using item-4, the question on deliberate self-harm without intent to die ("1" = none, "2" = occasional, "3" = frequent) in the screening section of the K-SADS-PL.
The K-SADS-PL is considered internationally reliable and valid diagnostic instrument for adolescent population . It has been translated (and back translated) into Finnish and used widely in studies concerning suicidality [e.g. [9, 28]]. Nine trained raters did the rating. Inter-rater reliability, assessed using 15 randomly selected videotaped interviews, was good for mood disorder diagnoses [weighted kappa  for MDD, other mood disorder, no mood disorder 0.87 (95 % CI 0.81, 0.93)].
3) Clinical suicidality assessment (CSA): A three-point mutually exclusive grouping of suicidality (1-non-suicidal, 2-suicide ideation, 3-suicide attempts) is a simplified version of the 5-item "Spectrum of Suicidal Behavior Scale" . It has been used in both research and clinical purposes [e.g. ]. The grouping is done by a clinician, and is based on two simple questions "Have you thought of killing yourself?" and "Have you attempted suicide?" and on patient records when appropriate. There is some evidence supporting the predictive validity of this grouping  but it has not been validated by comparing it with more structured measures like the K-SADS-PL. In this study, after a brief training the treating clinicians of the outpatient clinic did the CSA. They were instructed to include in class-3 also self-mutilation and other self-harming behavior with no explicit suicide intent.
After a description of the study, a written informed consent was obtained from the subjects. For subjects less than 18 years consent was also asked from the parents or other legal guardians. For the community sample the K-SADS-PL and the SSI were performed at the same day by an expert clinician. For the outpatient sample the K-SADS-PL was performed within variable time from the SSI rating. The CSA was performed for the patient sample by clinicians during the beginning of the treatment.
Central tendencies of some data were reported using medians and quartiles because of non-normal distribution. Mann-Whitney U test was used to assess the significance of differences between the two samples.
Internal consistency of the SSI was evaluated by calculation of Cronbach's α for the whole scale.
Concurrent validity of the instrument was examined by comparing it with the K-SADS-PL with the CSA classifications. SSI total scores were first assessed in 5 classes of increasing suicidality derived from the K-SADS-PL responses in the following way: 1-no suicidal ideation or acts, 2-mild suicidal ideation (score 2 on item-1), 3-severe suicidal ideation (score 3 on item-1), 4-mild suicidal acts (score 2 on any of items 2–4 regardless of ideation), 5-severe suicidal acts (score of 3 on any of items 2–4 regardless of ideation).
Then the SSI total scores were measured in 3 classes of increasing suicidal ideation severity, regardless of possible suicidal acts, derived from the K-SADS-PL responses on item 1: 1-no ideation, 2-mild ideation, and 3-severe ideation. Severe ideation (score 3) in this item was considered as "clinically significant suicidal ideation".
Finally the SSI total score was assessed in the three classes of the CSA: 1-no suicidality, 2-suicidal ideation, 3-suicidal or self-harming acts.
The statistical significance of the between-class differences was evaluated by Kruskal-Wallis test. For the analyses of concurrent validity only SSI-measurements in a range of 30 days from the K-SADS-PL and the CSA were included.
Construct validity was measured by performing a principal component analysis (PCA) with varimax rotation in the outpatient sample. The internal consistencies (Cronbach's α) of the extracted components as well as the originally reported factors  were calculated.
ROC-analysis was performed to evaluate the screening properties of the SSI, and the cutoff threshold for the instrument was defined by optimal trade-off between sensitivity and specificity (Youden's index ). The K-SADS-PL (score 3 in item-1) was used as the standard to define cases with clinically significant suicidal ideation.
SPSS 11.0 (Chicago, Illinois 60606, SPSS Inc) was used for the statistical analysis.
Eighteen percent (n = 40) of the outpatient sample were boys and 82% (n = 178) girls, in the community sample the percentages were 18.6% (n = 37) and 81.4% (n = 162), respectively. The subjects' mean age was 16.4 (SD 1.6) in the outpatient sample and 16.5 (SD 1.6) in the community sample. The median SSI total score for the patient sample was 0 (Q1–3 = 0–6) and for the community sample 0 (Q1–3 = 0-0) (z = -9.6, p = 0.000). The median SSI total score for subjects aged 13–15 was 0 (Q1–3 = 0–1) and those aged 16–19 0 (Q1–3 = 0–1) (z = -0.685, p = 0.493). The median time distance between SSI and K-SADS-PL was 21.5 days (Q1–3 = 9–36) for the patient sample and 0 days (Q1–3 = 0-0) for the control sample (z = -18.0, p = 0.000). The median time distance between SSI and the CSA was 6 days (range 0–35).
Forty-seven (21.6%) outpatients and one (0,5%) control subject had current clinically significant suicidal ideation (p = 0.000) according to the K-SADS-PL.
Cronbach's α was 0.95 for the whole sample, 0.81 for the community sample and 0.95 for the outpatient sample.
146 (67%) of the outpatients and 199 (99.5%) of the controls were included in the analyses for concurrent validity, as their measurements were within the required range of 30 days.
The median SSI sum scores in the five suicidality classes derived from the K-SADS-PL were class-1 = 0 (Q1–3 = 0-0); class-2 = 5.5 (Q1–3 = 0–8); class-3 = 13 (Q1–3 = 0–18.5); class-4 = 4 (Q1–3 = 0–17.3); class-5 = 8 (Q1–3 = 0–13). The differences were significant (χ2 = 111.6, df 4, p = 0.000).
The median SSI sum scores in the three classes of suicidal ideation derived from the K-SADS-PL were class-1 = 0 (Q1–3 = 0-0); class-2 = 4 (Q1–3 = 0–8); class-3 = 13 (Q1–3 = 4–18). The differences were significant (χ2 = 132.6, df 2, p = 0.000).
The median SSI sum scores in the three clinical suicidality evaluation classes (only the outpatient sample) were class-1 = 0 (Q1–3 = 0–1); class-2 = 10 (Q1–3 = 5–18); and class.3 = 15 (Q1–3 = 13.3–16.6). The differences were significant (χ2 = 57.9, df 2, p = 0.000).
Factor loadings and internal consistencies of the varimax rotated Principal Component Analysis (PCA) of the SSI in an outpatient sample of 218 adolescent outpatients with mood disorder. (* = Items that loaded identically to Beck's  original study) In the original study items 8, 10, 11 loaded on "active suicidal desire"-factor; items 13 and 15 on "preparation"-factor; and items 14 and 18 on "passive suicidal desire"-factor; item 17 did not load adequately on any of the factors.
(active suicidal desire)
(passive suicidal desire)
7. time dimension: frequency
6. time dimension: duration
4. desire to make active suicide attempt
9. control over suicidal action
1. wish to live
12. method: specificity/planning
2. wish to die
3. reasons for living/dying
14. sence of "capability"
13. method: availability/opportunity
α = 0.94
5. passive suicidal desire
19. deception/concealment of suicide
8. attitude toward ideation/wish
10. deterrents to active attempt
11. reason for contemplated attempt
15. expectancy/anticipation of event
α = 0.85
18. final acts
17. suicide note
16. actual preparation
α = 0.65
Validity as a screening instrument
Validity coefficients of different SSI cutoffs against K-SADS-PL diagnosed significant suicidal ideation at a mixed adolescent sample of 146 outpatients and 199 community controls
Validity coefficients of different SSI cutoffs against K-SADS-PL diagnosed significant suicidal ideation at an adolescent sample of 146 outpatients
This study was the first to evaluate the psychometric properties of the SSI in an adolescent population. It was a part of the ongoing Adolescent Depression Study (ADS) and the sample of patients was large compared to earlier similar studies in adult populations, and probably representative of adolescent psychiatric outpatients with depressive disorders. The main finding was that the SSI appeared to be a reliable and valid instrument for evaluation of suicidal ideation in a depressed adolescent population. Its internal consistency and different aspects of validity were good and similar to what has been reported among adults.
The construct validity of the SSI was checked by Principal Component Analysis, which yielded 3 theoretically meaningful and coherent factors, only slightly different from the original ones, with good internal consistencies. This suggests good construct validity. The first factor ("active suicidal desire") was nearly identical to Beck's original one . The second factor ("passive suicidal desire") included theoretically coherent items, two of which were identical to Beck's original factor of similar content. The third factor was also theoretically meaningful, included three items concerning final preparations, and had one item in common with Beck's original "preparations" factor.
The SSI converged theoretically meaningfully with both the three-class K-SADS-PL suicidal ideation-item and the clinical suicidality assessment (CSA); growing SSI scores were found within categories with increasing severity of suicidality. As to the convergence with the 5-class K-SADS-PL suicidality instrument, the results were more complex. The Kruskal-Wallis test yielded significant differences between the SSI scores in the different categories as expected, but the SSI-scores in the K-SADS-PL classes 4 and 5, with the supposedly most severe suicidality were not higher than in class 3. Classes 4 and 5 inquire about suicidal acts, and may represent a partly separate domain from suicidal ideation, which may be related to the presence of comorbid personality traits or conduct disorders. The SSI was designed to tap suicidal ideation and it may not satisfactorily tap features related with suicidal acts. In accordance with the theory of multidimensional nature of suicidality , severe suicidal ideation may not always be a prerequisite for suicidal acts in adolescents.
The authors are not aware of previous empirical estimations of clinically relevant cutoff for the SSI in adolescents. In this study ROC analysis of the whole sample yielded a reasonable result, but the validity coefficients for the different cutoffs of the SSI were somewhat difficult to interpret. In the community sample, there was only one subject with K-SADS-PL-diagnosed clinically significant suicidal ideation, which may have biased the analyses made with the whole sample. The results for both the whole sample and the patient sample suggest that a cutoff threshold score of four or more might be optimal for adolescents. Depending on the purpose the SSI is used, however, the emphasis between sensitivity and specificity may change, and a different threshold may be useful. For example, if the purpose is to detect the maximum number of potential suicides the cutoff threshold should be lowered to minimize the number of false negatives.
Several methodological limitations should be noted, some suggesting caution in interpreting the findings. Inter-rater and test-retest reliabilities, which would have given a complete picture of the reliability of the SSI, could not be evaluated in our setting; they would have required repeated SSI measurements for each subject. However, the alpha-coefficients are a marker of internal consistency, which is one indicator of reliability.
Although large and representative, the sample was a pure outpatient sample with age- and sex-matched controls, and females were over-represented. The absence of inpatients may have caused us to see the spectrum of suicidal ideation narrower than in real clinical situations. The sample was limited to an urban area in southern Finland, the generalizability of our findings to rural areas, or to other countries, is not known.
The use of K-SADS-PL as a standard for clinically significant suicidal ideation and behavior may be criticized, as the authors are not aware of a data on its validity. It is used, however, as one of the best available standards in adolescent mood disorder diagnostics, and taps suicidality with 4 relevant items.
The same rater rated the K-SADS-PL and the SSI, which is a weaker test of concurrent validity than correlating measures rated by separate raters.
The SSI can safely be used to evaluate suicidal ideation in adolescents where it seems to perform as well as in adults, where it is considered to be well established. When screening clinically significant suicidality in adolescents, a total score threshold of 3/4 may be useful.
Suicidal acts may occur among adolescents with only "mild" suicidal ideation. Thus, prevention of suicidal acts cannot rely solely on the SSI, which does not seem to tap them accurately. Furthermore, questionnaires should be only an adjunct to the clinical evaluation of suicidality.
SSI appears to be a reliable and a valid measure of suicidal ideation at depressed adolescents, with a cutoff threshold value of four or more of total SSI score being an appropriate for detecting significant suicidal ideation.
Acknowledgement of financial support: The study was financially supported by the Yrjö Jahnsson Foundation, Helsinki University Hospital and the Peijas Hospital.
We thank research assistant Mrs. Eevaliisa Orelma for her contribution in patient recruitment and data management.
- Brent DA, Baugher M, Bridge J, Chen T, Chiappetta L: Age- and sex-related risk factors for adolescent suicide. J Am Acad Child Adolesc Psychiatry. 1999, 38: 1497-1505. 10.1097/00004583-199912000-00010.View ArticlePubMedGoogle Scholar
- Groholt B, Ekeberg O, Wichstrom L, Haldorsen T: Suicide among children and younger and older adolescents in Norway: a comparative study. J Am Acad Child Adolesc Psychiatry. 1998, 37: 473-481. 10.1097/00004583-199805000-00008.View ArticlePubMedGoogle Scholar
- Marttunen MJ, Aro HM, Henriksson MM, Lönqvist JK: Mental disorder in adolescent suicide. DSM-III-R axes I and II among 13 to 19 year olds in Finland. Arch Gen Psychiatry. 1991, 48: 834-839.View ArticlePubMedGoogle Scholar
- Carlsten A, Waern M, Ekedahl A, Ranstam J: Antidepressant medication and suicide in Sweden. Pharmacoepidemiol Drug Saf. 2001, 10: 525-530. 10.1002/pds.618.View ArticlePubMedGoogle Scholar
- Olfson M, Shaffer D, Marcus SC, Greenberg T: Relationship between antidepressant medication treatment and suicide in adolescents. Arch Gen Psychiatry. 2003, 60: 978-982. 10.1001/archpsyc.60.9.978.View ArticlePubMedGoogle Scholar
- Whittington CJ, Kendall T, Fonagy P, Cottrell D, Cotgrove A, Boddington E: Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet. 2004, 363: 1341-1345. 10.1016/S0140-6736(04)16043-1.View ArticlePubMedGoogle Scholar
- Clarke RV, Lester D: Suicide: Closing the Exits. 1989, New York: Springer VerlagView ArticleGoogle Scholar
- Tardiff KJ, Leon AC, Marzuk P: Suicide risk measures. Manual for clinical rating scales. 2000, American Psychiatric AssociationGoogle Scholar
- Brent DA, Perper JA, Goldstein CE, Kolko DJ, Allan MJ, Allman CJ, Zelenak JP: Risk factors for adolescent suicide. A comparison of adolescent suicide victims with suicidal inpatients. Arch Gen Psychiatry. 1988, 45: 581-588.View ArticlePubMedGoogle Scholar
- Pelkonen M, Marttunen M, Pulkkinen E, Laippala P, Aro H: Characteristics of out-patient adolescents with suicidal tendencies. Acta Psychiatr Scand. 1997, 95: 100-107.View ArticlePubMedGoogle Scholar
- Beck AT, Kovacs M, Weissman A: Assessment of suicidal intention: the Scale for Suicide Ideation. J Consult Clin Psychol. 1979, 47: 343-352. 10.1037//0022-006X.47.2.343.View ArticlePubMedGoogle Scholar
- Beck A, Kovacs M, Weisman A: Beck Scale for Suicide Ideation. Handbook of psychiatric measures. 2000, American Psychiatric AssociationGoogle Scholar
- Allan WD, Kashani JH, Dahlmeier J, Taghizadeh P, Reid JC: Psychometric properties and clinical utility of the scale for suicide ideation with inpatient children. J Abnorm Child Psychol. 1997, 25: 465-473. 10.1023/A:1022633714888.View ArticlePubMedGoogle Scholar
- Joiner TE, Rudd MD, Rajab MH: The modified scale for suicidal ideation: factors of suicidality and their relation to clinical and diagnostic variables. J Abnorm Psychol. 1997, 106: 260-265. 10.1037//0021-843X.106.2.260.View ArticlePubMedGoogle Scholar
- Beck AT, Steer RA, Kovacs M, Garrison B: Hopelessness and eventual suicide: A 10-year prospective study of patients hospitalised with suicide ideation. Am J Psychiatry. 1985, 142: 559-563.View ArticlePubMedGoogle Scholar
- Beck AT, Brown GK, Steer RA, Dahlsgaard KK, Grisham JR: Suicide ideation at its worst point: A predictor of eventual suicide in psychiatric outpatients. Suicide Life Threat Behav. 1999, 29: 1-9.PubMedGoogle Scholar
- Brådvik L, Berglund M: Suicidal ideation in severe depression. Eur Arch Psychiatry Clin Neurosci. 2000, 250: 139-143. 10.1007/s004060070030.View ArticlePubMedGoogle Scholar
- Miller IW, Norman WH, Bishop SB, Dow MG: The modified scale for suicidal ideation: reliability and validity. J Consult Clin Psychol. 1986, 54: 724-725. 10.1037//0022-006X.54.5.724.View ArticlePubMedGoogle Scholar
- Beck AT, Steer RA: Manual for Beck scale for suicidal ideation. 1991, New York: Pensylvania CorporationGoogle Scholar
- Sokero TP, Melartin TK, Rytsala HJ, Leskela US, Lestela-Mielonen PS, Isometsa ET: Suicidal ideation and attempts among psychiatric patients with major depressive disorder. J Clin Psychiatry. 2003, 64: 1094-1100.View ArticlePubMedGoogle Scholar
- Guthrie E, Kapur N, Mackway-Jones K, Chew-Graham C, Moorey J, Mendel E, Marino-Francis F, Sanderson S, Turpin C, Boddy G, Tomenson B: Randomised controlled trial of brief psychological intervention after deliberate self poisoning. B M J. 2001, 323: 135-138.View ArticleGoogle Scholar
- Winters NC, Myers K, Proud L: Ten-year review of rating scales. III: scales assessing suicidality, cognitive style, and self-esteem. J Am Acad Child Adolesc Psychiatry. 2002, 41: 1150-1181. 10.1097/00004583-200210000-00006.View ArticlePubMedGoogle Scholar
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4: 561-571.View ArticlePubMedGoogle Scholar
- Goldberg D: The detection of minor psychiatric illness by questionnaire. 1972, Oxford: Oxford University PressGoogle Scholar
- Holi M, Marttunen M, Aalberg V: Comparison of the GHQ-36, the GHQ-12 and the SCL-90 as psychiatric screening instruments in the Finnish population. Nord J Psychiatry. 2003, 57: 233-238. 10.1080/08039480310001418.View ArticlePubMedGoogle Scholar
- Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, Williamson D, Ryan N: Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997, 36: 980-988. 10.1097/00004583-199707000-00021.View ArticlePubMedGoogle Scholar
- Brooks SJ, Kutcher S: Diagnosis and measurement of adolescent depression: a review of commonly utilized instruments. J Child Adolesc Psychopharmacol. 2001, 11: 341-376. 10.1089/104454601317261546.View ArticlePubMedGoogle Scholar
- Mäkikyrö T, Hakko H, Timonen MJ, Lappalainen JAS, Ilomäki RS, Marttunen MJ, Läksy K, Räsänen PK: Smoking and suicidality among adolescent psychiatric patients. J Adolesc Health. 2004, 34: 250-253. 10.1016/j.jadohealth.2003.06.008.View ArticlePubMedGoogle Scholar
- Fleiss JL, Cohen J: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement. 1973, 33: 6113-6619.View ArticleGoogle Scholar
- Pfeffer CR, Newcorn J, Kaplan G, Mizruchi MS, Plutchik R: Suicidal behavior in adolescent psychiatric inpatients. J Am Acad Child Adolesc Psychiatry. 1988, 27: 357-361.View ArticlePubMedGoogle Scholar
- Youden WJ: Index for rating diagnostic tests. Cancer. 1950, 3: 32-35.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/5/8/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.