Measuring cognitive insight in schizophrenia and bipolar disorder: a comparative study
© Engh et al; licensee BioMed Central Ltd. 2007
Received: 06 March 2007
Accepted: 11 December 2007
Published: 11 December 2007
Beck Cognitive Insight Scale (BCIS) has been designed for assessment of self-reflection on patients' anomalous experiences and interpretations of own beliefs. The scale has been developed and validated for patients with schizophrenia. We wanted to study the utility of the scale for patients with bipolar disorder. The relationship between the BCIS as a measure of cognitive insight and established methods for assessment of insight of illness was explored in both diagnostic groups.
The BCIS self-report inventory was administered to patients with schizophrenia (n = 143), bipolar disorder (n = 92) and controls (n = 64). The 15 items of the inventory form two subscales, self-reflectiveness and self-certainty.
The internal consistency of the subscales was good for the patient groups and the controls. The mean subscale scores were not significantly different for the three groups. Four items in subscale self-reflectiveness referring to psychotic experiences gave, however, different results in the control subjects. Self-certainty and scores on insight item PANSS correlated significantly in the schizophrenia, but not in the bipolar group.
BCIS with its two subscales seems applicable for patients with bipolar disorder as well as for patients with schizophrenia. The self-report inventory can also be applied to control subjects if the items referring to psychotic experiences are omitted. In schizophrenia high scores on self-certainty is possibly associated with poor insight of illness. For the bipolar group the subscales are largely independent of traditional insight measures.
Insight of illness is an important aspect in diagnostics and treatment of patients with severe mental disorders. Focus has primarily been on awareness of illness and treatment needs based on the widely used definition by Anthony David . Aaron T. Beck labeled this clinical insight . In addition to attenuated clinical insight, patients with psychosis often have reduced capacity to reflect rationally on their anomalous experiences and to recognize that their conclusions are incorrect . Beck termed such insight cognitive insight. He summarized the relevant components of this concept as "impairment of objectivity about the cognitive distortions, loss of ability to put these into perspective, resistance to corrective information from others and overconfidence in conclusions ."
To measure cognitive insight, he developed the Beck Cognitive Insight Scale (BCIS), a 15 item self-report instrument with two subscales, self-reflectiveness and self-certainty (Beck 2004). Acceptable levels of internal consistency (alpha self-reflectiveness 0.68, alpha self-certainty 0.60) were found for a mixed sample of patients with schizophrenia, schizoaffective disorder and major depression . For middle-aged and older patients with schizophrenia and schizoaffective disorder, acceptable internal consistency was later confirmed for self-reflectiveness (alpha 0.70), but not for self-certainty (alpha 0.50) .
The introduction of the BCIS has provided an opportunity to explore cognitive insight among patients with schizophrenia. Beck and colleagues recruited 150 inpatients, 75 diagnosed with schizophrenia and schizoaffective disorder and 75 with major depressive disorder. Twenty-one per cent in the latter group had psychotic depression. The authors  showed that the subscale self-certainty differentiated between major depressive patients with and without psychosis. However, the BCIS has not yet been validated for patients with bipolar I and bipolar II disorder, in whom lack of insight may also be a major clinical problem. We have earlier demonstrated that a self-report questionnaire assessing insight of illness with good psychometric properties for patients with schizophrenia may not necessarily function as well for patients with bipolar disorders . It is therefore important to study the psychometric qualities of the BCIS also for this patient group. Self-reflectiveness and self-certainty comprise items that seem to be rather general in content. Possibly, the two subscales cover a spectrum from normality to pathology. Warman et al. have recently published an article which points out that the factor loadings and internal consistencies of the BCIS were similar for healthy controls and the two groups of inpatients in Beck's original paper. We intended to replicate the investigation of the subscales' utility for normal controls.
The aims of the present study were: 1) to examine the subscale scores, internal consistency and intercorrelation of the BCIS' subscales for the schizophrenia group, the bipolar group and for normal controls, 2) to explore the relationship between the BCIS and affective symptom scores, and established scales for assessment of insight for the two diagnostic groups, and 3) to compare mean scores for patients and controls.
The subjects participated in a large ongoing study on schizophrenia and bipolar disorders (TOP Study, Thematic Organized Psychoses Research) and were recruited from out-patient and in-patient psychiatric units at four University Hospitals in Oslo, Norway, from March, 2005 through July, 2007. The health care system is catchment area based and the patients are referred from primary care. The patients were invited to participate in the study by the clinician responsible for their treatment.
All participants gave written informed consent, and the study was approved by the Regional Committee for Medical Research Ethics and the Norwegian Data Inspectorate.
The inclusion criteria were as follows: age 18 to 65 years, able to understand and speak a Scandinavian language, meeting the DSM-IV criteria for schizophrenia, schizoaffective, schizophreniform or bipolar disorder, no history of severe head trauma, IQ score of above 70 and willing and able to give informed consent. A total of 235 patients met the criteria. The schizophrenia group consisted of 143 patients with the DSM-IV diagnoses schizophrenia (n = 107), schizophreniform disorder (n = 10), and schizoaffective disorder (n = 26). Ninety-two patients were included in the bipolar group, diagnosed with either bipolar I disorder (n = 45), bipolar II disorder (n = 43) or bipolar NOS (n = 4). Sixty-four healthy subjects took part in the control group. Twenty-seven of these individuals were randomly selected from statistical records from the same catchment area as the patients. The remaining 37 persons were a mixed group of volunteering professionals. Detailed analyses of the subscale scores and intra class correlation showed similar results in the two control samples, and hence we refer only to one control group in this article.
Diagnosis was established using the Structured Clinical Interview for DSM-IV-TR-axis I disorders (SCID-I) . All interviewers finished a training course in SCID assessment based on the training program at UCLA  and participated in diagnostic evaluation meetings on regular basis led by a clinically experienced professor in psychiatry (S.O.). Mean overall kappa for SCID diagnoses assessed by the UCLA was 0.77 (95 % CI: 0.60–0.94).
History of mental illness, present symptoms, life style, and pharmacological treatment were obtained from interview with the patient, with additional information collected from treatment records and clinical staff. Severity of symptoms was assessed by the Positive and Negative Syndrome Scale PANSS (PANSS) , the Young Mania Rating Scale-Clinician rated (YMRS-C)  and the Inventory of Depressive Symptoms-Clinician rated (IDS-C) . The assessment of depression was conducted partly with the Inventory of Depressive Symptoms-Clinician rated (IDS-C), partly with CDSS (Calgary Depression Scale), but only the former scores are utilized in the study. Hence, there is a discrepancy between the number of patients with IDS scores and the number of patients with other symptom scores (PANSS, YMRS). Psychosocial functioning was measured by the Global Assessment of Functioning Scale (GAF) [11, 12], and the scores were split into scales of symptoms (GAF-S) and function (GAF-F) to improve psychometric properties. The inter-rater reliability of the investigators was good for the GAF with an intra class correlation, ICC 1.1, of 0.86 .
Assessment of cognitive insight and insight of illness
Insight of illness was assessed for both diagnostic groups by the PANSS insight item (G12) . A score of three or higher was defined as poor insight of illness.
Demographic and clinical variables
Schizophrenia (1) n = 143
Bipolar disorder (2) n = 92
Controls (3) n = 64
1 vs. 2
1 vs. 3
2 vs. 3
For the statistical analysis we used SPSS version 13. Student-t-test was utilized for examining statistical significance between the two patient groups on clinical variables. ANOVA and post-hoc tests were used when comparing all three groups on age and gender distribution, in addition to comparison of BCIS scores.
Few patients had missing data on the BCIS. The missing items were scattered on the various items in both subscales. On the average there were 1.5 total missing registrations per item for each of the patient groups. For the controls there was a clear difference between the subscales, as 14.3 % had omitted self-reflectiveness items, but only 3.1 % had left out self-certainty items. For PANSS total and YMRS total score there were 2 and 1 missing registrations respectively in the schizophrenia sample and 1 and 4 in the bipolar sample.
The internal consistency for the two subscales was calculated as Cronbach's alpha for the two diagnostic groups and for the controls. We followed the recommendations by Nunally that a satisfactory alpha equals or is higher than 0.70 .
The average correlation between each item and the remaining items within the subscale (corrected item total correlation, CITC) was also calculated. Furthermore, we computed the subscale intercorrelation for the different diagnostic groups. Finally, self-reflectiveness and self-certainty of the BCIS were correlated with scores on the G12 using the Pearson correlation test.
Psychometric properties and scale scores of the BCIS
Schizophrenia n = 143
Bipolar disorder n = 92
Controls n = 64
Bipolar disorder (2)
1 vs. 2
1 vs. 3
2 vs. 3
We found no significant difference in mean scores for self-reflectiveness or self-certainty in any of the groups. Additionally, both subscales showed similar variance in all groups.
BCIS subscales divided according to content
Self-reflectiveness divided in two components.
Bipolar disorder (2)
1 vs 2
1 vs 3
2 vs 3
Mean pr item
Mean pr item
Mean pr item
Relationship between scores on BCIS and psychopathology
There was no significant association between self-reflectiveness and YMRS total score or between self-reflectiveness and IDS total score in schizophrenia. For Self-certainty, however, we found a significant relationship to YMRS total score in this group. We did not find a significant association between any of the BCIS subscales and these measures of affective symptoms in the bipolar group. The relationship between the BCIS subscales and PANSS positive in the bipolar group was also nonsignificant.
Sixteen of the subjects diagnosed with bipolar disorder reported one or more previous psychotic episodes. These subjects attained scores on component I and II which were similar to the scores in the group of remaining subjects in the bipolar sample.
We wanted to investigate if there was a difference in self-reflectiveness and self-certainty scores between inpatients and outpatients. In a subsample of 78 schizophrenia patients no difference was found on self-reflectiveness or self-certainty scores. There were very few hospitalized bipolar patients and hence the comparison was unfeasible.
Comparing BCIS and measures of insight
Correlation coefficients between scores of cognitive insight and insight of illness for schizophrenia.
Correlation coefficients between scores of cognitive insight and insight of illness for bipolar disorder.
We calculated the correlation between self-reflectiveness, self-certainty and G12 score and found a highly significant positive correlation between self-certainty and G12 for schizophrenia.
The main finding was that the psychometric properties of both subscales of the BCIS were acceptable for the schizophrenia and for the bipolar group. The scores of the controls, however, can not be compared to patient scores without excluding items referring to psychotic experiences. Furthermore, the two subscales self-reflectiveness and self-certainty showed low or moderate correlation for the three groups, indicating that they represent two different dimensions of cognitive insight.
Internal consistency for each subscale of the BCIS was consistent across groups, somewhat higher for self-reflectiveness than for self-certainty. Previous findings for the schizophrenia group [2, 3] were thereby replicated. These findings are also in line with the results by Warman et al. which point out that the factor loadings and internal consistencies of the BCIS were similar for healthy controls and the two groups of inpatients in Beck's original paper. To our knowledge the psychometric properties of the BCIS have not previously been published for a bipolar sample.
The psychometric properties of the BCIS were similar for normal controls to what we found in schizophrenia and bipolar disorder. However, the self-reflectiveness scores in the two patient groups were actually higher than in the control group, although not statistically significant.Similar findings concerning scores on subscale self-reflectiveness was found in a recent study by Warman et al. comparing scores of undergraduate students with patients diagnosed with schizophrenia or schizoaffective disorder. In this study the controls scored non-significantly lower on self-reflectiveness and significantly lower on self-certainty than subjects in the schizophrenia group. Similarly, in a study by Eric Granholm (personal communication) middle aged and older controls obtained self-reflectiveness and self-certainty scores that were lower than the patient scores in the Beck study.
We wanted to investigate if different scoring profiles were present in the three groups. Comparing scores across these groups on component I which includes "unusual experiences" disclosed a significantly lower score for controls than both patient groups. This discrepancy indicates that the control subjects interpret the statements of these particular items rather differently from the patients, which is understandable due to lack of psychotic experiences in this group. Control subjects and patients seem to have a different reference point for 4 out of the 9 items in self-reflectiveness. This implies that comparison of scores between control subjects and patients should be carried out only for component II. On the other hand, the two components within self-reflectiveness were fairly strongly correlated for all groups, and consequently, there was no clear indication that they constitute two separate dimensions. Provided that the scores of the controls are not compared with patients whose interpretation of items involving "unusual experiences" are likely to be different, all items in subscale self-reflectiveness might be applicable for controls for means of investigating relations between cognitive insight and other domains such as psychopathology.
We also investigated the scores on each of these components in our bipolar sample and found that the patients with and without previous psychotic episodes did not come out differently. This could be considered as additional support to the applicability of the scale in bipolar samples.
Self-reflectiveness and self-certainty were weakly or moderately intercorrelated in the groups suggesting that they represent different dimensions. Self-certainty showed a highly significant positive correlation with G12 scores in the schizophrenia group, indicating that mental inflexibility is possibly associated with poor clinical insight of illness. For self-reflectiveness a significant negative correlation was found for this group, suggesting that the capacity to reflect on anomalous experiences is linked to insight of illness. Further exploration of self-certainty could expand our knowledge of cognitive processes involved in insight of illness in general, and in particular comprehending patients' lack of insight related to treatment need. The relationship between poor mental flexibility and both symptoms and cognition are not known, and investigating these associations could represent important topics for future studies.
The Beck Cognitive Insight Scale (BCIS) with its two subscales self-reflectiveness and self-certainty seems applicable for patients with schizophrenia and bipolar disorders. The BCIS can also be applied to control subjects, but in the case of comparison between controls and other clinical samples the four items referring to psychotic experiences should not be used. Our findings indicate that self-reflectiveness and self-certainty represent independent domains. In schizophrenia high self-certainty and low self-reflectiveness seem to be associated with poor insight of illness.
- David A: Insight. Lancet. 1990, 336: 634-10.1016/0140-6736(90)93436-S.View ArticlePubMedGoogle Scholar
- Beck AT, Baruch E, Balter JM, Steer RA, Warman DM: A new instrument for measuring insight: the Beck Cognitive Insight Scale. Schizophr Res. 2004, 68: 319-329. 10.1016/S0920-9964(03)00189-0.View ArticlePubMedGoogle Scholar
- Pedrelli P, McQuaid JR, Granholm E, Patterson TL, McClure F, Beck AT, et al: Measuring cognitive insight in middle-aged and older patients with psychotic disorders. Schizophr Res. 2004, 71: 297-305. 10.1016/j.schres.2004.02.019.View ArticlePubMedGoogle Scholar
- Jónsdóttir H, Engh JA, Friis S, Birkenaes AB, Ringen PA, Vaskinn A, Sundet K, Opjordsmoen S, Andreassen OA: Measurement of insight in patients with bipolar disorder. Are self-rated scales developed for patients with schizophrenia applicable?. J Nerv Ment Dis.
- Warman DM, Lysaker PH, Martin JM: Cognitive insight and psychotic disorder: the impact of active delusions. Schizophr Res. 2007, 90: 325-333. 10.1016/j.schres.2006.09.011.View ArticlePubMedGoogle Scholar
- Spitzer RL, Williams JB, Gibbon M, First MB: The Structured Clinical Interview for DSM-III-R (SCID). I: History, rationale, and description. Arch Gen Psychiatry. 1992, 49: 624-629.View ArticlePubMedGoogle Scholar
- Ventura J, Liberman RP, Green MF, Shaner A, Mintz J: Training and quality assurance with the Structured Clinical Interview for DSM-IV (SCID-I/P). Psychiatry Res. 1998, 79: 163-173. 10.1016/S0165-1781(98)00038-9.View ArticlePubMedGoogle Scholar
- Kay SR, Fiszbein A, Opler LA: The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987, 13: 261-276.View ArticlePubMedGoogle Scholar
- Young RC, Biggs JT, Ziegler VE, Meyer DA: A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978, 133: 429-435.View ArticlePubMedGoogle Scholar
- Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH: The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychol Med. 1996, 26: 477-486.View ArticlePubMedGoogle Scholar
- Endicott J, Spitzer RL, Fleiss JL, Cohen J: The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Arch Gen Psychiatry. 1976, 33: 766-771.View ArticlePubMedGoogle Scholar
- Pedersen G, Hagtvet KA, Karterud S: Generalizability studies of the Global Assessment of Functioning-Split version. Compr Psychiatry. 2007, 48: 88-94. 10.1016/j.comppsych.2006.03.008.View ArticlePubMedGoogle Scholar
- Shrout PE, Fleiss JL: Intraclass Correlations – Uses in Assessing Rater Reliability. Psychological Bulletin. 1979, 86: 420-428. 10.1037/0033-2909.86.2.420.View ArticlePubMedGoogle Scholar
- Sanz M, Constable G, Lopez-Ibor I, Kemp R, David AS: A comparative study of insight scales and their relationship to psychopathological and clinical variables. Psychol Med. 1998, 28: 437-446. 10.1017/S0033291797006296.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/7/71/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.