Research article | Open | Open Peer Review | Published:
Differences between patients' and clinicians' report of sleep disturbance: a field study in mental health care in Norway
BMC Psychiatryvolume 11, Article number: 186 (2011)
The aims of the study was to assess the prevalence of diagnosed insomnia and the agreement between patient- and clinician-reported sleep disturbance and use of prescribed hypnotic medication in patients in treatment for mental disorders.
We used three cross-sectional, multicenter data-sets from 2002, 2005, and 2008. Data-set 1 included diagnostic codes from 93% of all patients receiving treatment in mental health care in Norway (N = 40261). Data-sets 2 (N = 1065) and 3 (N = 1181) included diagnostic codes, patient- and clinician-reported sleep disturbance, and use of prescribed hypnotic medication from patients in 8 mental health care centers covering 10% of the Norwegian population.
34 patients in data-set 1 and none in data-sets 2 and 3 had a diagnosis of insomnia as a primary or comorbid diagnosis. In data-sets 2 and 3, 42% and 40% of the patients reported sleep disturbance, whereas 24% and 13% had clinician-reported sleep disturbance, and 7% and 9% used hypnotics. Patients and clinicians agreed in 29% and 15% of the cases where the patient or the clinician or both had reported sleep disturbance. Positive predictive value (PPV) of clinicians' evaluations of patient sleep disturbance was 62% and 53%. When the patient reported sleep disturbance as one of their most prominent problems PPV was 36% and 37%. Of the patients who received hypnotic medication, 23% and 29% had neither patient nor clinician-rated sleep disturbance.
When patients meet the criteria for a mental disorder, insomnia is almost never diagnosed, and sleep disturbance is imprecisely recognized relative to the patients' experience of sleep disturbance.
Sleep disturbance is likely to be a core feature across several mental disorders [1, 2]. In patients with depression, sleep disturbance predicts poorer treatment outcome and is associated with more suicide attempts [3, 4]. Moreover, 40%-70% of patients successfully treated for depression still experience sleep disturbance after treatment [3, 5], and these patients may be at a higher risk of relapses into new episodes . This challenges the assumption that the sleep disturbance will also be improved once the primary mental disorder is treated. It may be more adequate to assume that there is a need for specific treatment for sleep disturbance for these patients.
Adequate management of insomnia starts with recognition and diagnostic assessment. There is a risk, however, that insomnia could become trivialized in mental health care because it is both a diagnosis as well as a symptom of several mental disorders. But although many may share the impression that insomnia is under-recognized by clinicians [7, 8], the actual data available from medical practice is limited and ambiguous. Two studies have confirmed that sleep is seldom documented in medical charts in general hospitals  or on general medical services , whereas a recent large-scale study concluded that sleep disturbance is adequately recognized by general practitioners . Only one study has been conducted to test if sleep disturbance is clinically recognized in patients with mental disorders . The authors found that 80 of 100 patients on a psychiatric consultation service had sleep disorders but disturbed sleep was not mentioned in the records of 54% of these patients. However, the study was conducted in the early 1980s and had limited external validity. The state of sleep in psychiatry might be different 30 years later. Thus, even though 50% to 80% of patients with mental disorders have sleep disturbance , there is currently limited empirical knowledge about diagnostic assessment, clinical recognition and treatment for this large group of patients.
As the DSM and the ICD will be revised during the next years there is currently a need for data that can inform this revision process . The primary users of these diagnostic systems are mental health care personnel and general medical clinicians and the classifications should therefore be meaningful for these groups . A basic test of clinical utility is to explore whether clinicians in mental health care use the insomnia diagnosis. However, because insomnia is also a symptom of several mental disorders, there is a possibility that clinicians could recognize and treat sleep disturbance without diagnosing it.
The aims of this study were therefore to examine whether insomnia is diagnosed and whether sleep disturbance is recognized and treated in patients with mental disorders. We used three large, cross sectional, multicenter data-sets for this purpose.
Data-set 1 included demographic information and clinical diagnostic codes from an estimated 93% of all patients receiving treatment in mental health care, both private practice and public health care, in Norway during two weeks in 2008.
In addition to demographic and clinical diagnostic assessments, data-sets 2 and 3 also included both clinicians' and patients' report of sleep disturbance and prescriptions of hypnotic medication. Data-sets 2 and 3 were conducted at eight public mental health centers during eight weeks in 2002 and four weeks in 2005, respectively. The centers were selected to be representative for the country as a whole and the catchment areas covered about 10% of the Norwegian population. The centers covered both rural and urban areas as well as northern and southern parts of the country. The data collections were commissioned by the Norwegian Department of Health to evaluate the state of the National Mental Health Care System and were not designed specifically to evaluate sleep disturbance in patients with mental disorders.
Data-sets 1, 2 and 3 were used to assess the prevalence of clinically diagnosed insomnia. Data-sets 2 and 3 were also used to assess the agreement between clinician and patient reported sleep disturbance and prescription of hypnotic medication. The analyses were replicated in the data-sets to test the reliability of the findings.
Data-set 1 included 40 261 patients. Patients were between 18 and 103 years old. See table 1 for demographic data.
In data-set 2, a total of 3 497 patients were enrolled and 1 065 patients (30%) were included in the current study as they agreed to have their self-report linked to their clinician's diagnoses and symptom reports and treatment. Patients were between 18 and 85 years old.
In data-set 3, a total of 3041 patients were enrolled and 1181 patients (39%) were included as they agreed to have their self-report linked to their clinician's diagnoses and symptom reports and treatment. Patients were between 18 and 82 years old.
All data collections were commissioned by the Norwegian Department of Health and conducted by an independent research institution, SINTEF Technology and Society.
Diagnosis of insomnia
Primary and one (data-set 1) or two (data-sets 2 and 3) additional ICD-10  diagnoses were recorded by the clinicians in charge. The procedure for the diagnostic evaluation varied within and between clinics and mirrored clinical practice. There were missing diagnoses for 46 patients in data-set 2 and 241 in data-set 3. Patients with a diagnosis of F51.0 Non-organic insomnia as either a primary, secondary or tertiary diagnosis were categorized as having a diagnosed insomnia. See table 2 for diagnostic criteria.
Patient-reported sleep disturbance
Patients completed the Symptom Checklist - 25 (SCL-25) in data-set 2 and the Symptom Checklist - 10 in data-set 3 (SCL-10). Both are short versions of the SCL-90-R and the Norwegian translations have satisfactory validity and reliability . The SCL-25 consists of 25 items, and the SCL-10 consists of 10 items, describing psychiatric symptoms rated on a 4-point scale (1 = not at all, 4 = very severe). All items on the SCL-10 are present in the SCL-25.
Three items measure sleep disturbance on the SCL-90R. On the SCL-25 and the SCL-10, these three have been reduced to one item measuring the severity of sleep disturbance. This item was used to assess patient rated level of sleep disturbance. Patients who scored 3 or 4 (quite severe or very severe) on this item were categorized as having patient-rated sleep disturbance.
Clinician-reported sleep disturbance
The clinicians used the Health of Nations Outcome Scales (HoNOS) to evaluate the patients. The HoNOS is a 12-item instrument measuring behavior, impairment, symptoms and social functioning for patients with mental disorders . HoNOS item 8 requires the clinicians to identify mental or behavioral problems from a list of 10: phobic, anxiety, obsessive-compulsive, stress, dissociative, somatoform, eating, sleep disturbance, sexual, or other. The clinicians reported the three most prominent problems in data-set 2 and the most prominent problem in data-set 3 on HoNOS item 8. The HoNOS item 8 was rated on a binary scale for the current study (present or not present). Patients who the clinicians indicated had a sleep disturbance on HoNOS Item 8 were categorized as having clinician-rated sleep disturbance.
Patients who were prescribed one or more of the following medications: Zopiclone, Zolpidem, Nitrazepam, Flunitrazepam, Trimeprazime and Promethazine.
The clinicians' accuracy in recognizing the patients' sleep disturbance was reported as positive and negative predictive value. The following definitions were used.
True Positive (TP) means both the patient and clinician had reported sleep disturbance; False Positive (FP) means the patient had not reported sleep disturbance but the clinician had; False Negative (FN) means that the patient had reported sleep disturbance but the clinician had not; True Negative (TN) means the both the patient and the clinician had not reported sleep disturbance.
Positive predictive value was calculated using the equation: TP/(TP + FP). This indicates the proportion of the clinicians' evaluations of sleep disturbance that were correct, i. e. similar to patient experience. Negative predictive value was calculated using the equation: TN/(FN + TN). This indicates the proportion of clinicians' evaluations of no sleep problem that were correct.
Differences between data-set 2 and 3 were calculated using Mann-Whitney U-tests. Diagnostic differences in agreement were calculated using Chi-squared analyses. Because of the large sample size and multiple tests, level of statistical significance was set to p < 0.001.
The three studies were approved by The Regional Committee for Medical Research Ethics, Middle Norway.
In data-set 1, 34 of 40 621 patients (0.08%, [95% CI: 0.05% - 0.11%]) had received an ICD-10 diagnosis of insomnia. In data-sets 2 and 3 no patients had received an ICD-10 diagnosis of insomnia.
Prevalence of patient and clinician-reported sleep disturbance and use of hypnotics
Table 3 indicates the prevalence of patient and clinician-reported sleep disturbance and prescription of hypnotics in data-sets 2 and 3.
233 patients (22% [19% - 24%]) in data-set 2 and 299 patients (25% [23% - 28%]) in data-set 3, reported sleep disturbance to be one of the most prominent symptoms, as indicated by a score of 3 or above on the SCL sleep item and scores of less than, or equal to, the score of sleep disturbance on the remaining 24 symptoms on the SCL-25 (data-set 2) or 9 symptoms on the SCL-10 (data-set 3). In addition, 331 patients (31%, [28% - 34%]) in data-set 2 and 416 patients (35% [32% - 38%]) in data-set 3, reported sleep difficulties of mild symptom severity (score of 2 on the SCL sleep item).
There were more patients with clinician-rated sleep disturbance in data-set 2 compared to data-set 3 (p < 0.001). There were no differences between the two data-sets in patient-rated sleep disturbance and prescription of hypnotic medication.
There were no differences between patients in any of the sleep disturbance categories or prescription of hypnotic medication and other patients in age, gender, type of treatment, or between the eight different clinics in either data-set 2 or 3.
Of the patients with either patient- or clinician rated sleep disturbance, patients and clinicians agreed in 29% (25% - 33%) of the cases in data-set 2 and 15% (12% - 18%) in data-set 3.
The average positive predictive value (PPV) of clinicians' evaluations of the patients' sleep disturbance was 62% (58% - 66%) in data-set 2 and 53% (49% - 57%) in data-set 3. Average negative predictive value (NPV) was 64% (60% - 68%) in data-set 2 and 61% (57% - 65%) in data-set 3.
To test if clinicians had higher precision rate if the patient experienced sleep disturbance as one of their most prominent symptoms, we also calculated PPV and NPV for patients with self-reported sleep disturbance as one of the most prominent symptoms. For these patients, PPV was 36% (30% - 42%) in data-set 2 and 37% (32% - 42%) in data-set 3. NPV was 83% (78% - 87%) in data-set 2 and 76% (71% - 81%) in data-set 3.
Among the patients who were prescribed hypnotic medication, 55% (44% - 66%) had a clinician reported sleep disturbance in data-set 2 and 26% (18% - 34%) in data-set 3. In addition, 23% (13% - 33%) in data-set 2 and 29% (20% - 38%) in data-set 3 had neither patient- nor clinician-rated sleep disturbance.
The overlap between the patients with self-reported sleep disturbance, the patients with clinician-rated sleep disturbance and the patients who were prescribed hypnotic medication in data-set 2 are described in Figure 1. The overlap between patients with a self-reported sleep disturbance as one of the most prominent symptoms, patients with clinician rated sleep disturbance and patients who were prescribed hypnotic medication in data-set 3 are described in Figure 2.
Because clinicians might be more likely to assess sleep disturbance in certain disorders, we conducted χ 2 for selected diagnostic groups (substance abuse, schizophrenia, bipolar disorder, depressive episode, recurrent depressive episode, anxiety disorders, adjustment disorders and personality disorders) in chapter V of the ICD-10 to test if there were differences in agreement in these patient groups. There were no differences in agreement in any diagnostic group in data-set 2. In data-set 3, agreement was higher when the patient had a diagnosis of depressive episode (χ 2 (1) = 31.6, p ≤ 0.001) compared to other patients.
Using three independent and nationally representative data-sets, we found that the diagnosis of insomnia was virtually non-existent in patients with mental disorders. Only 34 of 42507 patients had a diagnosis of insomnia as either a primary or a comorbid diagnosis. However, about 40% of all patients experienced severe sleep disturbance and at least 22% reported this to be one of their most prominent problems. Although they did not diagnose it, clinicians indicated that 24% of their patients had sleep disturbance as a prominent problem. We found a notable discrepancy between the clinicians' report and the patients' report of sleep disturbance. The patients and clinicians agreed in less than 30% of the cases where either the patients or clinicians had reported sleep disturbance. The probability of the patients themselves experiencing sleep disturbance when the clinician reported this, was less than 62%. This probability was surprisingly even lower when the patient experienced their sleep disturbance to be one of their most prominent symptoms, with a predictive value of less than 37%. Thus, the precision of clinician-rated sleep disturbance was close-to-chance when compared to the patient report. Of the patients who used hypnotics, 55% reported having sleep disturbance whereas 23% had neither clinician nor patient reported sleep disturbance. These findings were replicated with only minor differences in the different samples.
The diagnostic findings are at odds with findings from epidemiological studies where the prevalence has been reported to be about 100 times higher [18–20]. However, our findings are in line with two previous studies where large discrepancies between findings from epidemiological studies and diagnostic practice in clinical settings have been reported [21, 22]. Although the diagnostic recommendation in the ICD-10 is to code insomnia as a comorbid disorder if it is one of the most prominent symptoms, our findings indicate that clinicians are reluctant to use these recommendations.
Underlying this may be a long-standing issue of whether insomnia should be regarded as a symptom of other disorders or as a disorder in it self. Clinicians may not find it relevant to code insomnia as a comorbid condition as they regard it as a part of the primary mental disorder. If clinicians do not find the diagnosis of insomnia relevant to their practice, this may raise concerns about the usefulness of the diagnosis in its current form. In this respect it is interesting to note that the online draft of the DSM-5 proposes to remove the diagnosis of Insomnia Related to Another Mental Disturbance and only operate with the diagnosis of Insomnia. The proposed change in the DSM reflects a change in paradigm from thinking of insomnia as a symptom to thinking of insomnia as a disorder. It recommends coding Insomnia Disorder if the criteria are fulfilled regardless of meeting criteria for other mental disorders, because determining the cause or consequence of the problem is clinically difficult, if not impossible .
Patient report of sleep disturbance was higher than what is found in the general population using similar measures , but in agreement with other studies from patients with mental disorders . Hypnotic medication was, relative to previous studies [24, 25], seldom prescribed to the patients in the current study. Less than 9% of all patients were prescribed such medication compared to 7% of the general population in Norway in the same period . Patients with mental disorders are likely to be prescribed other medications that have effects on sleep, such as some anti-depressants or anti-psychotic medication that could make hypnotic medication less needed. Still, it is curious that at least 23% of the patients who were prescribed hypnotic medication had neither self-reported nor clinician-reported sleep disturbance. This could indicate that patients who are being prescribed hypnotics stay on hypnotics after the sleep disturbance has been treated.
The low recognition of sleep disturbance raises questions concerning education and training of health care professionals. Although a call for improved education about sleep was made in the 1980s when similar findings were reported , the situation does not seem to have improved. Physician training in the recognition of sleep specific symptoms has been reported to be minimal . Similarly, a survey of 212 directors of graduate and internship programs of clinical psychology revealed that only 6% of the programs offered courses in sleep and most reported that their institution was ineffective in providing sleep education . Moreover, doctors seldom ask about sleep in clinical interviews , and patients with sleep disturbance infrequently report this to their clinicians [29, 30]. This makes it important for health care professionals to have knowledge about the features of sleep.
There is a possibility of sampling bias in data-sets 2 and 3 as about two-thirds of the original sample of patients did not agree to have their self-report linked to the clinician-report. This could be an artifact of the procedures. The patients had to specifically indicate that they wanted to have their scores linked to their clinicians' ratings, rather than having to indicate if they did not want to have their scores linked. This difference could have had a large impact on patient participation .
Clinicians in data-set 3 were asked to only indicate the most prominent problem the patient experienced compared to the three most prominent problems reported by clinicians in data-set 2. This gave a lower prevalence of clinician-rated sleep disturbance in data-set 3 compared to data-set 2. In both data-sets clinicians have therefore only indicated the patients who they regard as having sleep disturbance as one of their most prominent problems. The study was not primarily designed to measure sleep disturbance in mental health care and we might have found a higher prevalence of clinician-rated sleep disturbance if we had utilized a survey directly inquiring about sleep symptoms. This could have resulted in higher agreement and different predictive values for clinician's evaluations. However, our finding that even when clinicians evaluate sleep disturbance to be one of the most prominent problems, there is still a very low agreement between patients and clinicians. Especially as the predictive value of the clinicians' report was less than chance for the patients who reported sleep disturbance as one of their most prominent problems.
The use of a single item measuring sleep disturbance is another limitation. This means that it is not possible to discern if there were differences in agreement between sleep onset or sleep maintenance problems or if the patients experienced other kinds of sleep disturbance.
Finally, although we have assessed patients who received hypnotic medication, there might be a proportion of the patients who received alternate medication or non-pharmacological interventions for their sleep disturbance.
When patients meet the criteria for a mental disorder, insomnia is almost never diagnosed, and sleep disturbance is imprecisely recognized relative to the patients' experience of sleep disturbance.
Our results, rather than taken as criticism of individual health care professionals, should be interpreted as a call for improved teaching and better understanding of sleep disturbance and its treatment. Moreover, the non-existence of the insomnia diagnosis in three different clinical samples may not only be a result of insufficient training, but also indicate an area where revising the ICD and DSM systems could be useful. The suggested change in the DSM-5 of coding insomnia is likely to be favorable compared to the current system and could be considered also in the ICD-11.
Conflicts of interest
The authors declare that they have no competing interests.
Harvey AG: Sleep and Circadian Functioning: Critical Mechanisms in the Mood Disorders?. Annu Rev Clin Psychol. Epub 2010 Apr 5
Harvey AG, Murray G, Chandler RA, Soehner A: Sleep disturbance as transdiagnostic: Consideration of neurobiological mechanisms. Clin Psychol Rev. Epub 2010 Apr 24
Nierenberg AA, Keefe BR, Leslie VC, Alpert JE, Pava JA, Worthington JJ, Rosenbaum JF, Fava M: Residual symptoms in depressed patients who respond acutely to fluoxetine. J Clin Psychiatry. 1999, 60: 221-225. 10.4088/JCP.v60n0403.
Wojnar M, Ilgen MA, Wojnar J, McCammon RJ, Valenstein M, Brower KJ: Sleep problems and suicidality in the National Comorbidity Survey Replication. J Psychiatr Res. 2009, 43: 526-531. 10.1016/j.jpsychires.2008.07.006.
Nierenberg AA, Husain MM, Trivedi MH, Fava M, Warden D, Wisniewski SR, Miyahara S, Rush AJ: Residual symptoms after remission of major depressive disorder with citalopram and risk of relapse: a STAR*D report. Psychol Med. 2010, 40: 41-50. 10.1017/S0033291709006011.
Reynolds CF, Frank E, Houck PR, Mazumdar S, Dew MA, Cornes C, Buysse DJ, Begley A, Kupfer DJ: Which elderly patients with remitted depression remain well with continued interpersonal psychotherapy after discontinuation of antidepressant medication?. Am J Psychiatry. 1997, 154: 958-962.
Benca RM: Diagnosis and treatment of chronic insomnia: a review. Psychiatr Serv. 2005, 56: 332-343. 10.1176/appi.ps.56.3.332.
Shapiro CM, Dement WC: ABC of sleep disorders. Impact and epidemiology of sleep disorders. BMJ. 1993, 306: 1604-1607. 10.1136/bmj.306.6892.1604.
Meissner HH, Riemer A, Santiago SM, Stein M, Goldman MD, Williams AJ: Failure of physician documentation of sleep complaints in hospitalized patients. West J Med. 1998, 169: 146-149.
Namen AM, Landry SH, Case LD, McCall WV, Dunagan DP, Haponik EF: Sleep histories are seldom documented on a general medical service. South Med J. 2001, 94: 874-879.
Sivertsen B, Nordhus IH, Bjorvatn B, Pallesen S: Sleep problems in general practice: a national survey of assessment and treatment routines of general practitioners in Norway. J Sleep Res. 2010, 19: 36-41. 10.1111/j.1365-2869.2009.00769.x.
Berlin RM, Litovitz GL, Diaz MA, Ahmed SW: Sleep disorders on a psychiatric consultation service. Am J Psychiatry. 1984, 141: 582-584.
Morin CM, Ware JC: Sleep and psychopathology. Applied & Preventive Psychology. 1996, 5: 211-224. 10.1016/S0962-1849(96)80013-8.
Reynolds CF, Redline S: The DSM-V sleep-wake disorders nosology: an update and an invitation to the sleep community. Sleep. 2010, 33: 10-11.
World Health Organization: The ICD-10 Classification of Mental and Behavioural Disorders, Clinical Description and Diagnostic Guidelines. 1992, Oslo: Gyldendal Akademisk Forlag
Strand BH, Dalgard OS, Tambs K, Rognerud M: Measuring the mental health status of the Norwegian population: a comparison of the instruments SCL-25, SCL-10, SCL-5 and MHI-5 (SF-36). Nord J Psychiatry. 2003, 57: 113-118. 10.1080/08039480310000932.
Wing JK, Beevor AS, Curtis RH, Park SB, Hadden S, Burns A: Health of the Nation Outcome Scales (HoNOS). Research and development. Br J Psychiatry. 1998, 172: 11-18. 10.1192/bjp.172.1.11.
Ford DE, Kamerow DB: Epidemiologic study of sleep disturbances and psychiatric disorders. An opportunity for prevention?. JAMA. 1989, 262: 1479-1484. 10.1001/jama.262.11.1479.
Ohayon MM: Epidemiology of insomnia: what we know and what we still need to learn. Sleep Med Rev. 2002, 6: 97-111. 10.1053/smrv.2002.0186.
Pallesen S, Nordhus IH, Nielsen GH, Havik OE, Kvale G, Johnsen BH, Skjotskift S: Prevalence of insomnia in the adult Norwegian population. Sleep. 2001, 24: 771-779.
Fireman B, Koran LM, Leventhal JL, Jacobson A: The prevalence of clinically recognized obsessive-compulsive disorder in a large health maintenance organization. Am J Psychiatry. 2001, 158: 1904-1910. 10.1176/appi.ajp.158.11.1904.
Katzelnick DJ, Kobak KA, DeLeire T, Henk HJ, Greist JH, Davidson JR, Schneier FR, Stein MB, Helstad CP: Impact of generalized social anxiety disorder in managed care. Am J Psychiatry. 2001, 158: 1999-2007. 10.1176/appi.ajp.158.12.1999.
The DSM -5 Development Homepage. [http://www.dsm5.org/ProposedRevisions/Pages/proposedrevision.aspx?rid=65#]
Mojtabai R, Olfson M: National trends in psychotropic medication polypharmacy in office-based psychiatry. Arch Gen Psychiatry. 2010, 67: 26-36. 10.1001/archgenpsychiatry.2009.175.
Okuji Y, Matsuura M, Kawasaki N, Kometani S, Shimoyama T, Sato M, Oga K, Abe K: Prevalence of insomnia in various psychiatric diagnostic categories. Psychiatry Clin Neurosci. 2002, 56: 239-240. 10.1046/j.1440-1819.2002.01012.x.
Rosen RC, Rosekind M, Rosevear C, Cole WE, Dement WC: Physician education in sleep and sleep disorders: a national survey of U.S. medical schools. Sleep. 1993, 16: 249-254.
Meltzer LJ, Phillips C, Mindell JA: Clinical psychology training in sleep and sleep disorders. J Clin Psychol. 2009, 65: 305-318. 10.1002/jclp.20545.
Haponik EF, Frye AW, Richards B, Wymer A, Hinds A, Pearce K, McCall V, Konen J: Sleep history is neglected diagnostic information. Challenges for primary care physicians. J Gen Intern Med. 1996, 11: 759-761. 10.1007/BF02598994.
Ancoli-Israel S, Roth T: Characteristics of insomnia in the United States: results of the 1991 National Sleep Foundation Survey. I. Sleep. 1999, 22 (Suppl 2): S347-353.
Leger D, Poursain B: An international survey of insomnia: under-recognition and under-treatment of a polysymptomatic condition. Curr Med Res Opin. 2005, 21: 1785-1792. 10.1185/030079905X65637.
Johnson EJ, Goldstein D: Medicine. Do defaults save lives?. Science. 2003, 302: 1338-1339. 10.1126/science.1091721.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/11/186/prepub
Acknowledgements and funding
We thank Dr. Stephen Lock for valuable help on drafting the manuscript. We would also like to thank researcher Solfrid Lileeng who was responsible for the data collection and to SINTEF Technology & Society for allowing us to use the data. The data collection was funded by the Norwegian Department of Health. The report was written with funding from the Norwegian ExtraFoundation for Health and Rehabilitation.
HK conceptualized the report, did the data analyses, data interpretation, and wrote the report. BH, KL, GM, and TCS conceptualized the report, did data interpretation, and critical appraisals of the report. RG and TR made the study designs, conducted the data collections, and made critical appraisals of the report. All authors read and approved the final manuscript.