- Research article
- Open Access
The Internalized Stigma of Mental Illness (ISMI) scale: validation of the Japanese version
BMC Psychiatry volume 16, Article number: 116 (2016)
The present study investigated the reliability and validity of a Japanese version of the Internalized Stigma of Mental Illness (ISMI) scale, designed to assess internalized stigma experienced by people with mental illness.
A survey was conducted with 173 outpatients with mental illness who attended psychiatric clinics on a regular basis. A retest was conducted with 51 participants to evaluate the scale’s psychometric properties.
The alpha coefficient for the overall internal consistency was 0.91, and the coefficients of the individual ISMI subscales ranged from 0.57 to 0.81. The test–retest reliability was r = 0.85 (n = 51, P < 0.01). In terms of criterion-related validity, the Japanese version of the ISMI scale was significantly correlated with the Beck Depression Inventory (r = 0.61, P < 0.01), the Rosenberg Self-Esteem Scale (r = −0.53, P < 0.01), and the Empowerment Scale (r = −0.52, P < 0.01). In addition, factor analyses of the ISMI items demonstrated a four-factor solution for the alienation, stereotype endorsement, discrimination experience, and social withdrawal subscales, with the stigma resistance items excluded.
The Japanese version of the ISMI scale demonstrated similar reliability and validity to the original English version. Therefore, the Japanese version of the ISMI scale may be an effective and valid tool to measure internalized stigma among Japanese people who have a mental illness.
Corrigan proposed a framework that categorized stigma as either public stigma or internalized stigma . “Public stigma” describes the ways in which the general public stigmatizes people with a mental illness, and “internalized stigma” or “self-stigma” represents the internalization of this public stigma . For people with mental illness, internalized or self-stigma is characterized by a subjective perception of devaluation, marginalization, secrecy, shame, and withdrawal [3, 4]. Internalized stigma has a variety of adverse effects, including eroding an individual’s social standing and social networks, and contributing to diminished self-esteem and slower recovery [3, 5]. Internalized stigma is a risk factor for a poorer mental health prognosis .
In Japan, prejudice and discrimination against people with mental illness persists. People with mental illness are often isolated under the pretext of hospitalization. The 2011 Patient Survey conducted by the Japanese Ministry of Health, Labour and Welfare found that about 320,000 people with mental illness were hospitalized. This represents 27 hospitalized psychiatric patients per 10,000 people in Japan: the largest number worldwide. Hospitalized people have fewer opportunities for close contact with others, which contributes to a vicious cycle that further delays deinstitutionalization. Moreover, people with mental illness are less likely to find employment than those with physical or intellectual disabilities. Private companies in Japan with more than 50 employees have a 2.0 % employment quota for people with disabilities; these companies employ around 431,225 people with disabilities. Of those employees, 313,314 have physical disabilities, 90,203 have intellectual disabilities, and 27,708 have mental illness (2014 Survey on the Employment Situation of Persons with Disabilities, Japanese Ministry of Health, Labour and Welfare). The self-devaluation, shame, secrecy, and social withdrawal associated with internalized stigma increase the difficulty of overcoming existing barriers to employment .
Systematic measurement of internalized stigma provides clinicians and clinical researchers with a confirmable and viable target for general psychotherapeutic interventions. A commonly used measure of internalized stigma is the Internalized Stigma of Mental Illness Scale (ISMI) [3, 7]. The ISMI scale was developed to measure the internalized stigma of people with a mental illness. The scale comprises questions covering the present time and is focused on the respondent’s identity and experience as someone with a mental illness, rather than focusing on hypothetical situations. Worldwide, the ISMI scale has been used as a measure of internalized stigma for people with schizophrenia, depression, leprosy, and AIDS [6, 8–12]. Although the ISMI scale is commonly used to measure internalized stigma, it has not yet been translated into Japanese. Therefore, the present study aimed to test its reliability and validity in a Japanese population.
Participants and procedures
Survey participants were 206 Japanese people who attended eight social welfare facilities in Gunma Prefecture and 13 facilities in Niigata Prefecture in Japan between January and July 2012. The study population comprised individuals with a psychiatric condition that impacted on their ability to function optimally and who were using outpatient mental health services. People attending these facilities are required to submit a medical certificate from a psychiatrist when they register. The presence of mental illness was determined from these medical certificates. We distributed survey material describing the purpose and methods of the study, invitation letters, informed consent forms, and survey questionnaires to participants at the identified facilities. In total, 194 people consented to participate and 12 people refused. Inclusion criteria were use of the selected facilities and ability to understand the Japanese questionnaires. Exclusion criteria were intellectual disability or organic brain disease (n = 7) and inability to complete the ISMI questions (n = 14). This left 173 participants eligible for study participation. All 173 participants provided informed consent to participate and were surveyed. The study protocol was approved by the Institutional Review Board at Kiryu University.
The participants included 111 males (64.2 %) and 62 females (35.8 %); 62 participants were from eight facilities in Gunma Prefecture (35.8 %) and 111 were from 13 facilities in Niigata Prefecture (64.2 %). These facilities were selected from the teaching facilities for nursing students in Chu-etsu in Niigata Prefecture, and Isesaki City and Kiryu City in Gunma Prefecture. Participants’ self-reported diagnoses were schizophrenia (81.5 %), depression (8.1 %), bipolar disorder (5.8 %), and other psychotic disorders (4.6 %) (Table 1).
Retesting was conducted with 55 participants 56–118 days (average 83.1 days) after the initial survey. We excluded responses with missing data and responses indicative of intellectual disability or organic brain disease. Responses from 51 participants were analyzed (92.7 % of the retest sample returned a valid response).
Both the initial and the retest questionnaires were administered to participants in groups of 5–10, and collected on completion.
Participants were asked to report their age, sex, place of residence, marital status, level of education, diagnosis, and the age of onset of their illness.
Internalized Stigma of Mental Illness (ISMI) scale
The ISMI scale comprises 29 items across five subscales : alienation (6 items), stereotype endorsement (7 items), discrimination experience (5 items), social withdrawal (6 items), and stigma resistance (5 items). The items for each subscale are shown in Table 2. Each item is rated on a four-point Likert scale from 1 (strongly disagree) to 4 (strongly agree). The five stigma resistance subscale items are reverse-coded, and also serve as a validity check . The stigma resistance score is calculated by subtracting the actual value from five. Therefore, stigma resistance displays the same direction of correlation as the other four subscales. A high total score on the ISMI scale indicates more severe internalized stigmatization. The internal consistency of the original version was 0.90 (n = 127) and the test–retest reliability coefficient was r = 0.92 (n = 16, P < 0.05) after a 6-week interval. The internal consistency and test–retest reliability for the five subscales were: alienation, 0.79, 0.68; stereotype endorsement, 0.72, 0.94; discrimination experience, 0.75, 0.89; social withdrawal, 0.80, 0.89; and stigma resistance, 0.58, 0.80 .
The original English version of the ISMI scale was translated into Japanese, and then back-translated into English by two people with a good command of English. This back-translation was sent to the authors of the original English version to obtain their opinion as to its suitability. This back-translation process was repeated five times, with Ritsher and colleagues approving the final translation for use as the Japanese version of the ISMI scale Additional file 1.
Three scales were identified to test criterion validity based on previous research .
Beck Depression Inventory (BDI)
The BDI is a subjective self-evaluation scale comprising 21 items measuring depressive symptoms [13, 14] and is commonly used in Japan. Each item is evaluated on a scale from 0 (none) to 3 (severe), with the total score ranging from 0 to 63. The severity of depressive symptoms is determined from the total score, with higher scores indicating more severe symptoms. Mean scores and standard deviations (SD) were 12.6 (SD = 9.9, n = 120), and the internal consistency reliability was 0.93 .
Rosenberg Self-Esteem Scale (RSES)
Self-esteem was measured using the RSES [15, 16]. RSES items are evaluated on a four-point Likert scale from 1 (strongly disagree) to 4 (strongly agree). The total score ranges from 4 to 40, with higher scores reflecting higher levels of self-esteem. The reliability and validity of the Japanese version of the RSES were verified by Uchida et al. .
Empowerment Scale (ES)
Empowerment refers to an individual’s power with respect to their own daily life and to the living environment and society in which they are placed [18–20]. This represents a motivated attitude, and the polar opposite of internalized stigma. The ES, developed by Rogers et al., is a self-administered scale that evaluates the mental aspects of empowerment, and was designed for people with mental illness . The ES consists of 28 questions, evaluated on a four-point Likert scale from 1 (strongly agree) to 4 (strongly disagree). The total score ranges from 28 to 112; a higher score indicates a higher level of empowerment. ES items include “I have a positive attitude about myself,” “I feel powerless most of the time,” and “People have more power if they join together as a group.” The reliability and validity of the Japanese version of the ES were verified by Hata et al. .
The reliability of the Japanese version of the ISMI scale was evaluated by testing the internal consistency of the items using Cronbach’s alpha, and by the scale’s test–retest reliability using Pearson’s correlation coefficients (r) between total scores. The validity of the scale was investigated through criterion-related validity and construct validity. Criterion-related validity was verified through the correlation of the ISMI scale with the BDI, the RSES, and the ES. Construct validity was investigated using maximum likelihood factor analysis with a promax rotation of 24 items in four subscales, excluding the stigma resistance subscale. As a result of factor analysis of the ISMI scale and other scales, Ritsher et al. were able to sort 24 items (excluding the five stigma resistance subscale items) onto the expected factor structure. The factor analyses in the present study were performed in the same manner as in Ritsher et al. . The eigenvalues-greater-than-1.0 rule was applied to clarify the number of factors extracted. The differences in total ISMI score by sex, place of residence, education, marital status, cohabitation, and period of facility use were investigated using t-tests and one-way analysis of variance. All analyses were performed using SPSS Version 21.0 (IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: IBM Corp.).
Total ISMI scores
Mean scores and SDs were obtained for the five subscales: alienation, 2.35 (SD = 0.63); stereotype endorsement, 2.10 (SD = 0.48); discrimination experience, 2.25 (SD = 0.60); social withdrawal, 2.27 (SD = 0.56); and stigma resistance, 2.75 (SD = 0.48). The means of the ISMI subscale scores and the proportion of participants above the midpoint (2.5) are shown in Table 2. There were no statistically significant differences in ISMI mean total scores for sex, residence area, education, marital status, cohabitation, and period of facility use. There was no statistically significant difference in ISMI mean total score for self-reported diagnosis (Table 3).
The alpha coefficient for the internal consistency of the overall scale was 0.88. Table 4 shows the Cronbach’s alphas for each subscale in the Japanese version of the ISMI scale, alongside those obtained for the original English version. The alphas for each subscale in the Japanese version ranged from 0.57 to 0.81; the lowest coefficient was 0.57 for the stigma resistance subscale.
Significant correlations were found for all subscale scores: total score, r = 0.85 (P < 0.01); alienation, r = 0.83 (P < 0.01); stereotype endorsement, r = 0.79 (P < 0.01); discrimination experience, r = 0.79 (P < 0.01); social withdrawal, r = 0.73 (P < 0.01); and stigma resistance, r = 0.71 (P < 0.01).
The ISMI subscales were positively correlated with the BDI and negatively correlated with the RSES and the ES. The ISMI total scores were correlated with the BDI (r = 0.61, P < 0.01), the RSES (r = —0.53, P < 0.01), and the ES (r = —0.52, P < 0.01). Table 5 shows the correlations between the ISMI scores and the scores for the other three scales. All correlations were significant (P < 0.01).
Table 6 shows the factor analysis for the 24 items in four subscales (excluding the stigma resistance subscale). Four factors were obtained. The first factor included almost all of the social withdrawal items. The second factor included the alienation and stereotype endorsement items, with alienation showing a higher loading. The third factor included almost all discrimination experience items. The fourth factor included the stereotype endorsement items.
The results of the present study demonstrate that the Japanese version of the ISMI scale has good reliability and validity. The reliability was evaluated by testing the internal consistency of the items, and by the test–retest reliability of the scale. The validity of the scale was investigated with criterion-related validity and construct validity. We obtained similar results to the original scale for internal consistency, test–retest reliability, criterion-related validity, and construct validity.
Analysis of the internal consistency of the Japanese version of the ISMI scale supported the reliability of the scale. The subscale with the lowest internal consistency was stigma resistance, which was consistent with the original version of the ISMI scale. The internal consistency was similar when we compared other subscales. In addition, the overall internal consistency of the Japanese version of the ISMI scale was similar to that of the original English version.
The test–retest reliability coefficient for the present study was similar to the value for the original English version . The correlations were also close and may not be significantly different from each other. Therefore, the Japanese version of the ISMI scale demonstrated a similar level of reliability to the original version. The average test–retest interval was 83.1 days (range 56–118 days); we could have conducted a test–retest study using shorter and more consistent intervals. However, in other test–retest studies with stigma scales, the study intervals were 2 weeks , 5 weeks , 6 weeks , and 4 months ; our test–retest interval was in the range of those studies. In our test–retest study population, the ISMI scores were relatively stable over time.
Our results for criterion-related validity were consistent with those obtained for the original English version of the ISMI scale; the BDI showed a positive association with the ISMI scale, and the RSES and the ES showed negative associations. In general, tendencies toward stigma and depressive symptoms are negatively-themed constructs, while self-esteem and empowerment are positive constructs. The correlations obtained in the present study represent strong evidence for the criterion-related validity of the Japanese version of the ISMI scale.
In our examination of construct validity, we also obtained the same result as for the original English version. Four factors were obtained from the factor analysis: the first factor was social withdrawal, the second was alienation, the third was discrimination experience, and the fourth factor was stereotype endorsement. Although the first factor included both social withdrawal and alienation items, there were more social withdrawal items. This was consistent with the results of the factor analysis of the original version of the ISMI scale. Therefore, the Japanese version of the ISMI scale appears to have sufficient construct validity. In general, Japanese people do not like direct expression. Therefore, in our translation, we used expressions to represent the scale items that were as sensitive as possible. As a result, the translation was not an exact match. By repeating the back-translation a number of times, we were able to develop a Japanese version of the ISMI scale that was consistent with the versions used in other countries. That is, the final Japanese expressions used reflected the original questions well.
To examine differences across countries in ISMI subscale scores of people with schizophrenia, we compared our findings with those from eight other studies [8, 25–31]. There were no large differences in mean scores on the stigma subscales across the countries reviewed (Table 7). The means for Japan were low, and the scoring profile (except for stigma resistance) resembled findings from China, also located in East Asia. Ersoy et al. found that the total score differed significantly by sex and income when testing the Turkish version of the ISMI scale: men had higher scores than women, and individuals with low or moderate income levels had higher scores than those with higher incomes . The effects of sex, education, and other demographic variables on the ISMI scale scores were not reported in the original English version. In the present study, there were no significant differences in the association between the total ISMI scale score and demographic variables. This indicates that the Japanese version of the ISMI scale can be used with diverse populations with different demographics.
There are some limitations in our study, including a potential response bias in the test–retest because of the test and retest timing. In addition, the participants in the present study were outpatients who used social welfare facilities, and 81.5 % were patients with schizophrenia. The nationwide Japanese Patients Survey conducted by the Japanese Ministry of Health, Labour and Welfare found that 18.7 % of outpatients and 58.5 % of inpatients with a mental illness had schizophrenia. Therefore, our study population may not be representative of the Japanese population with a mental illness. Moreover, we did not measure cultural or ethnographic variables such as religion.
In a pilot study, we found that some participants were not able to complete the questionnaire by themselves. Therefore, in the present study, participants received guidance in the form of a researcher who read questions and answer selections aloud and waited for participants’ responses. Therefore, the reliability and validity of the scale self-administered without this guidance may differ from the present study.
The results of the present study demonstrated that the Japanese version of the ISMI scale has similar levels of reliability and validity to the original English version. Therefore, the Japanese version of the ISMI scale may be used as a valid tool to reliably measure internalized stigma in Japanese people who have a mental illness. We hope that this scale will be of use to clinicians and researchers in Japan to advance understanding of the internalized stigma experienced by people who have a mental illness.
Ethics approval and consent to participate
The study was conducted after the approval of the study protocol by Kiryu University Institutional Review Board. Participation was voluntary and information was collected anonymously after obtaining written consent from each respondent by assuring confidentiality throughout the data collection period.
Consent for publication
Availability of data and materials
Data and materials supporting our findings in the manuscript will not be shared. It was not in accordance with participants’ written informed consent.
Corrigan PW. On the stigma of mental illness Washington: practical strategies for research and social change. Washington DC: American Psychological Association; 2005.
Corrigan PW, Watson AC. The paradox of self-stigma and mental illness. Clin Psychol. 2002;9(1):35–53.
Ritsher JB, Otilingam PG, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiat Res. 2003;121(1):31–49.
Corrigan PW. The impact of stigma on severe mental illness. Cogn Behav Pract. 1998;5(2):201–22.
Link BG, Phelan JC. Conceptualizing stigma. Annu Rev Sociol. 2001;27:363–85.
Boyd JE, Adler EP, Otilingam PG, Peters T. Internalized Stigma of Mental Illness (ISMI) scale: a multinational review. Compr Psychiatry. 2014;55(1):221–31.
Livingston JD, Boyd JE. Correlates and consequences of internalized stigma for people living with mental illness: a systematic review and meta-analysis. Soc Sci Med. 2010;71(12):2150–61.
Botha UA, Koen L, Niehaus DJ. Perceptions of a South African schizophrenia population with regards to community attitudes towards their illness. Soc Psych Psych Epid. 2006;41(8):619–23.
Tang IC, Wu HC. Quality of life and self-stigma in individuals with schizophrenia. Psychiat Quart. 2012;83(4):497–507.
Ersoy MA, Varan A. Reliability and validity of the Turkish version of the internalized stigma of mental illness scale. Turk Psikiyatri Derg. 2007;18(2):163–71.
Oliveira SE, Esteves FG, Pereira EG, Carvalho M, Boyd JE. The Internalized Stigma of Mental Illness: cross-cultural adaptation and psychometric properties of the Portuguese version of the ISMI scale. Community Ment Health J. 2015;51(5):606–12.
Stevelink SA, van Brakel WH, Augustine V. Stigma and social participation in Southern India: Differences and commonalities among persons affected by leprosy and persons living with HIV/AIDS. Psychol Health Med. 2011;16(6):695–707.
Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4(6):561–71.
Beck AT, Brown GK, Steer RA. Beck Depression Inventory II manual. San Antonio: The Psychological Corporation; 1996.
Rosenberg M. Society and the adolescent self-image. Princeton: Princeton University Press; 1965.
Rosenberg M. Conceiving the self. New York: Basic Books; 1979.
Uchida T, Ueno T. Reliability and validity of the Rosenberg self esteem scale: using the Japanese version of the RSES by Mimura & Griffiths (2007). Annu Rep Grad Sch Educ Tohoku Univ. 2010;58(2):257–66 (in Japanese).
Rogers ES, Chamberlin J, Ellison ML, Crean T. A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatr Serv. 1997;48(8):1042–7.
Corrigan PW, Faber D, Rashid F, Leary M. The construct validity of empowerment among consumers of mental health services. Schizophr Res. 1999a;(38):77-84.
Corrigan PW, Giffort D, Rashid F, Leary M, Okeke I. Recovery as a psychological construct. Community Ment Health J. 1999b;(35):231-9.
Hata A, Maeda K, Tsujii K, Asai H, Akiyama N, Kaneko M. Applying the Japanese version of “Empowerment Scale” to schizophrenia patients. Clin Psychiatr. 2003;45(7):733–40 (in Japanese).
Michael K, Sokratis D, Jenifer S, Robert W, Scott S, et al. The Stigma Scale: development of a standardized measure of the stigma of mental illness. Brit J Psychiat. 2007;190(3):248–54.
Sibitz I, Provaznikova K, Lipp M, Lakeman R, Amering M. The impact of recovery-oriented day clinic treatment on internalized stigma: Preliminary report. Psychiat Res. 2013;209(3):326–32.
Peter H, Grace W, Jenifer AB, Dominic L. Stigma and self-esteem in manic depression: an exploratory study. J Affect Disord. 2002;69(1-3):61–7.
Lv Y, Wolf A, Wang X. Experienced stigma and self-stigma in Chinese patients with schizophrenia. Gen Hosp Psychiat. 2013;35(1):83–8.
Brohan E, Elgie R, Sartorius N, Thornicroft G, GAMIAN-Europe Study Group. Self-stigma, empowerment and perceived discrimination among people with schizophrenia in 14 European countries: the GAMIAN-Europe study. Schizophr Res. 2010;122(1-3):232–8.
Sibitz I, Unger A, Woppmann A, Zidek T, Amering M. Stigma resistance in patients with schizophrenia. Schizoph Bull. 2011;37(2):316–23.
Lysaker PH, Tsai J, Yanos P, Roe D. Associations of multiple domains of self-esteem with four dimensions of stigma in schizophrenia. Schizophr Res. 2008;98(1-3):194–200.
Lysaker PH, Roe D,Yanos PT. Toward understanding the insight paradox: Internalized stigma moderates the association between insight and social functioning, hope, and self-esteem among people with schizophrenia spectrum disorders. Schizophr Bull. 2007a;33(1):192-9.
Lysaker PH, Davis LW, Warman DM, Strasburger A, Beattie N. Stigma, social function and symptoms in schizophrenia and schizoaffective disorder: Associations across 6 months. Psychiat Res. 2007b;149(1-3):89-95.
Assefa D, Shibre T, Asher L, Fekadu A. Internalized stigma among patients with schizophrenia in Ethiopia: a cross-sectional facility-based study. BMC Psychiatry. 2012;12:239.
We are deeply grateful to the participants and staff of social welfare facilities in Gunma and Niigata Prefectures for their assistance with this study. This work was supported by the Japan Society for the Promotion of Science (JSPS) KAKENHI Grant Number 50515319.
Anyone who wishes to use the Japanese version of the ISMI scale is requested to contact the authors.
The authors declare that they have no competing interests.
YT conceived the study, participated in its design and coordination, carried out the survey, and drafted the manuscript. KH and YI participated in the design of the study and performed the statistical analysis. All authors read and approved the final manuscript.
About this article
Cite this article
Tanabe, Y., Hayashi, K. & Ideno, Y. The Internalized Stigma of Mental Illness (ISMI) scale: validation of the Japanese version. BMC Psychiatry 16, 116 (2016). https://doi.org/10.1186/s12888-016-0825-6
- Internalized stigma
- Mental health
- Mental disorders
- Validation study