Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health
BMC Psychiatry volume 12, Article number: 36 (2012)
Many people with mental illness do not seek or delay seeking care. This study aimed to develop, and provide an initial validation of, a comprehensive measure for assessing barriers to access to mental health care including a ‘treatment stigma’ subscale, and to present preliminary evidence about the prevalence of barriers experienced by adults currently or recently using secondary mental health services in the UK.
The Barriers to Access to Care Evaluation scale (BACE) was developed from items in existing scales, systematic item reduction, and feedback from an expert group. It was completed in an online survey by 117 individuals aged 18 and over who had received care from secondary mental health services in the past 12 months. Internal consistency, test-retest reliability, convergent validity (correlation of treatment stigma subscale with the Stigma Scale for Receiving Psychological Help (SSRPH) and with the Internalised Stigma of Mental Illness Scale (ISMI)), respondent opinion and readability were assessed.
The BACE items were found to have acceptable test-retest reliability as all but one of the items exceeded the criterion for moderate agreement. The treatment stigma subscale had acceptable test-retest-reliability and good internal consistency. As hypothesised the subscale was significantly positively correlated with the SSRPH and the ISMI demonstrating convergent validity. The developmental process ensured content validity. Respondents gave the BACE a median rating of 8 on the 10-point quality scale. Readability scores indicated the measure can be understood by the average 11 to 12 year-old. The most highly endorsed barrier was ‘concern that it might harm my chances when applying for jobs’. The scale was finalised into a 30-item measure with a 12-item treatment stigma subscale.
There is preliminary evidence demonstrating the reliability, validity and acceptability of the BACE. It can be used to ascertain key barriers to access to mental health care which may help to identify potential interventions to increase care seeking and service use. Further research is needed to establish its factor analytic structure and population norms.
Avoidance of mental health care
A large proportion of people with mental illness do not receive care . In Europe 27% of people experience mental illness (all disorders) each year, but 74% receive no treatment . For mood, anxiety and substance use disorders severe enough to significantly interfere with everyday life, only 48% received any formal healthcare . The figures for individuals with the same disorders in the USA are 31% with the mental disorders and 67% not treated . In these countries much of the treatment gap can be accounted for by people not seeking or delaying seeking mental health care. In low and middle income countries there are even greater levels of undertreatment  due to both avoidance of health care and lack of care provision. Not seeking health care, or delayed care-seeking, may result in there being a longer period of untreated illness and, for psychotic illness, this is associated with worse outcomes such as having more symptoms, poorer functioning and quality of life and reduced likelihood of remission . It may also contribute to adverse pathways to care such as the involvement of the criminal justice system and involuntary admissions under mental health legislation . When individuals do seek or receive care they may subsequently drop out of services or may have low levels of engagement with services such as missing appointments or not seeking care in a crisis . Therefore health care-seeking can be conceptualised as a process not restricted to the period before first contact with services. Whilst mental illness sometimes remits without professional care, avoidance of health care at any stage in this process may result in an individual not receiving effective treatments, which may contribute to the continuation of illness and the negative impacts that illness can bring, although this is not always so, particularly for less severe conditions.
The reasons why people with mental ill health sometimes avoid or delay seeking help from health services are numerous and include instrumental barriers such as not knowing where to go for help, or financial barriers, or they may be attitudinal such as perceived lack of effectiveness of treatments offered, thinking the problem will resolve itself, preferring to solve the problem on one’s own, and fear of being hospitalised against one’s will [9, 10]. One reason that has received increasing research attention is the potential for stigma and discrimination to act as barriers to access to health care-seeking. Four reviews have examined the impact of stigma on access to mental health care and each concluded that it had a significant detrimental effect [11–14]. Prospective studies provide evidence that stigma may have a negative impact on service use [15, 16]. Thus it is clear that both non-stigma-related (instrumental / attitudinal) and stigma-related barriers limit access to mental health care, but what is not currently known is the relative influence of these different types of barriers.
Measuring mental health care-seeking
In the context of an ongoing systematic review on the association between stigma and health care we identified the following types of measure that have been used to assess mental health care seeking: previous / current actual service use; intention to seek health care; attitudes to health care seeking; recommendations regarding health care seeking for a vignette character; and barriers-based measures in which respondents are presented with a list of potential barriers and are asked whether, or not or to what extent, each has been a barrier for them. The advantage of barriers-based measures is that they indicate what prevents or delays individuals from health care-seeking and so may inform interventions to increase health care seeking and service use. We identified 23 studies that had assessed barriers to mental health care seeking [9, 17–38].
A limitation of the existing barriers-based measures was that they did not always provide a comprehensive list of barriers. This was particularly true for stigma where measures sometimes simply referred to stigma as a barrier rather than enquiring about particular components of stigma (e.g. embarrassment / shame, concern about others’ disapproval, disclosure concerns, desire to avoid a stigma stereotype, and anticipated discrimination). Additionally the measures often had dichotomous response categories, when barriers are often experienced to a lesser or greater extent. Existing measures rarely encompassed service avoidance post-first contact. A final limitation is that few of the existing measures produced composite scores even though such scoring may be conceptually meaningful for some types of barrier e.g. stigma-related barriers.
Measuring ‘treatment stigma’
‘Treatment stigma’ refers to the stigma and discrimination that individuals believe to be associated with receiving care for a mental health problem. We identified nine treatment stigma scales or subscales [27, 39–46] from our on-going systematic review. The measures were in the main Likert attitude scales (measures with statements followed by ‘strongly agree’, ‘agree’ etc.). Only three measures were barriers-based [40, 43, 45]. A strength of a barriers-based measure of treatment stigma is that it is more tied to behaviour than attitudinal measures and permits the influence of stigma-related barriers to be compared to that of other types of barriers. However the existing barriers-based measures of treatment stigma cannot readily be used with general mental health populations as one is for adolescents , one has been used predominantly in military settings  and one mainly in the context of psychotherapy . Furthermore there is no existing measure of treatment stigma which is applicable to all mental health conditions, all types of mental health care and all types of stigma. For example, some measures focus solely on specific conditions such as depression [27, 44, 46]; some refer solely to psychological help [41–43, 45] and some to care from a psychiatrist . Some measures exclusively assess the internalised stigma associated with receiving mental health care [42, 44]; one focuses on the public stigma associated with psychological care for mental ill health , and one measures anticipated discrimination .
Need for a new measure
We conclude from the overview of existing research and issues discussed above that there is a need for a comprehensive measure of barriers to access to professional care for mental ill health that has nominal rather than categorical response categories. In addition there is a currently unmet need for a barriers-based measure of treatment stigma that may be completed by individuals with any type of mental health problem, regarding any type of professional care, and covering all types of treatment stigma. We believe that a measure that encompasses health-care-seeking post- and well as pre- first receipt of care is needed to better reflect the fact that care-seeking is a process. The measure described here meets these three sets of requirements within one measure.
This study aimed to:
develop a comprehensive self-complete measure - the Barriers to Access to Care Evaluation (BACE) - for assessing barriers to care-seeking for mental ill health, encompassing care avoidance post- as well as pre-contact with services;
develop from a subset of the BACE items a subscale for assessing the stigma associated with receiving mental health care (treatment stigma);
establish the psychometric properties of the BACE and its treatment stigma subscale;
present preliminary evidence about the prevalence of stigma-related and non-stigma-related barriers to care-seeking for mental ill health reported by a sample of adults recently or currently using secondary mental health services.
The design is a four-stage psychometric validation study. Stage one involved the collation and reduction of barriers items from the existing literature and the creation of a draft measure. In stage two an expert panel revised the measure. Stage three was a cross-sectional survey repeated for test-retest reliability. This was embedded within a survey whose primary purpose was to develop another scale, the Questionnaire on Anticipated Discrimination (QUAD). Stage four was the finalisation of the measure based on psychometric findings from the survey.
Sample and recruitment
As the BACE is intended for completion by individuals at any stage in the health care seeking process including those who have not and who have already received mental health care, we made a pragmatic decision to use the latter type of sample, taking the opportunity to include the preliminary BACE scale in the QUAD study. Inclusion criteria for the QUAD study, and consequently also the present study, were: 1) Having received care from secondary mental health services in the 12 months or currently; 2) aged 18 or over; and 3) access to the internet as the survey was to be completed online. Participants were recruited through the following routes: emails to members who participated in a previous phase of the QUAD development study in our research programme (all living in South-East England); and advertisements on websites and social networks (Facebook, Twitter) of England’s national anti-discrimination programme (Time to Change) and of two national UK mental health charities (Rethink, Mental Health Foundation). The target sample size was 100 (with 50 completing the survey a second time for assess test-retest reliability) and was based on the numbers required to perform the analyses needed for the psychometric validation of the QUAD.
The QUAD study and an amendment permitting the inclusion of the BACE v2, and the Stigma Scale for Seeking Psychological Help  were approved by the King’s College London Psychiatry, Nursing and Midwifery Research Ethics Sub-Committee (ref: PNM/09/10-103).
The BACE scale was developed through an iterative process. In stage one, one author (SC) collated barriers items from the 23 barriers studies [9, 17–38] that we identified in our on-going systematic review on the association between stigma and health care seeking. These studies included samples of individuals with a variety of mental health problems and sociodemographic characteristics, who had and had not previously accessed care for mental health problems, as well as some general population studies. This initial method of sourcing items was chosen to capitalise on the large body of existing work in this area and to avoid duplication of effort. Items that were identical to other items, not relevant to a general population, ambiguous or rarely endorsed in the studies reporting them were then excluded from the item pool. When items used different words to refer to the same barrier, one item was selected, or the items were rephrased into a single new item. The research team then added items not yet covered that were known to be important in the qualitative and theoretical research literature on health care seeking. This set constituted the items for the BACE v1. The research team devised a root question: ‘Have any of these issues ever stopped, delayed or discouraged you from getting, or continuing with, professional care for a mental health problem?’. Professional care was defined as ‘care from such staff as a GP (family doctor), community mental health team (e.g. care coordinator, mental health nurse or mental health social worker), psychiatrist, counsellor, psychologist or psychotherapist’. The response categories were ‘This has stopped, delayed or discouraged me not at all / a little / quite a lot / a lot’.
In stage two BACE v1 was sent to an expert panel for comment. The panel comprised three people with experience of mental illness (various diagnoses, all with experience of both using and avoiding mental health care), three social scientists working in the field of stigma and / or help-seeking, three clinicians (two psychiatrists and a mental health nurse) and a lay person with no post-16 education to check for clarity and ease of understanding. The feedback was used to delete, add and rephrase items to create the BACE v2. Each item was designated by the research team, on a conceptual basis, as being either a stigma-related or non-stigma-related barrier to care seeking.
In stage three participants completed the BACE v2 and other measures in an anonymised online survey. Participants were invited to recomplete the BACE v2 two weeks later, also online. The fourth stage of scale development was to modify the BACE v2 on the basis of the psychometric findings and further discussion within the research team into the BACE v3.
Three measures relevant to this study were included in the survey: (i) the Barriers to Access to Care Evaluation (BACE v2); (ii) the Stigma Scale for Receiving Psychological Help (SSRPH) ; and (iii) the Internalised Stigma of Mental Illness (ISMI) . The latter two were used for assessing the convergent validity of the BACE. The Barriers to Access to Care Evaluation (BACE v2) is a 36-item measure scored from 0 (not at all) to 3 (a lot) with higher scores indicating a greater barrier. The BACE treatment stigma subscale score is the mean of stigma-related barriers ratings. It ends with space for free text entries describing two other barriers participants may have experienced. The Stigma Scale for Receiving Psychological Help (SSRPH)  is a 5-item measure of treatment stigma focusing predominantly on social stigma. Golberstein’s  adapted version referring to any type of mental health treatment was used. It has four response categories from strongly disagree to strongly agree, with a high scores indicating greater treatment stigma. Its internal consistency is alpha = 0.72 . The Internalised Stigma of Mental Illness (ISMI) scale is a 29-item measure that assesses mental health service users’ experience of internalised stigma . It has four response categories from strongly disagree to strongly agree and high scores indicate high internalised stigma. It has strong internal consistency (α = 0.90) and test–retest reliability (r = 0.92) . In addition participants were asked ‘Please choose one number between 1 (very poor) and 10 (very good) to show your overall opinion of the BACE questionnaire?’ and to add free text comments about the measure. There were further items on sociodemographic and illness characteristics.
To assess the test-retest reliability of individual items weighted intra-class correlation co-efficients were calculated with kappa’s above 0.4 indicating moderate agreement  as the criterion for acceptable reliability. Lin’s concordance statistic (ρc) was used to calculate the overall test-retest reliability for the treatment stigma subscale , with a criterion of Lin’s ρc >0.70 used to indicate acceptable reliability. The internal consistency of the treatment stigma subscale was assessed using Cronbach’s alpha, with a value above 0.7 but not higher than 0.9 taken to indicate good internal consistency .
Content validity is the extent to which a measure comprehensively covers domains of interest  and was assured by the development of the measure having incorporated the extant literature, and the perspectives of people with mental illness and professional experts. A further indication of this type of validity was provided by content analysis of free text answers about other barriers. Construct validity was assessed by examining convergent validity , hypothesising that the treatment stigma subscale would be significantly positively correlated with both the SSRPH and the ISMI.
Two aspects of the acceptability of the measure were considered: respondent opinion and readability. Descriptive statistics on respondents’ overall ratings of the BACE.v2 were calculated. The readability of the BACE v3 was assessed using the Flesch Reading Ease score and Flesch-Kincaid Grade level functions within Microsoft Word which assess readability based on the syllabic and sentence structure of the text . Scores for the former range from 0–100 with higher scores meaning easier to read and scores of 60-70 representing acceptable scores for documents for general adult populations. The latter provides the US educational grade to which the material is most appropriate .
Finalising the BACE v2 into the BACE v3
Items which were endorsed as a major barrier by less than 10% of the sample were considered for removal as were items that were very highly correlated with other items (Spearman’s rho > 0.7) and those with poor or slight test-retest agreement (Kappa ≤ 0.2 . Conceptual and wording issues were also further considered at this stage and amendments made.
Prevalence of stigma-related and non-stigma-related barriers
Percentages endorsing each item as a barrier (to any degree) or as a major barrier (rated as ‘a lot’) were calculated together with mean ratings. Barriers were then ranked by percentage rating them as a major barrier to show the relative prevalence of stigma-related and non-stigma-related barriers.
117 individuals completed the survey, and 59 of these participants recompleted the BACE to provide test-retest reliability data. Those providing the test-retest data did not differ significantly from the remainder of the sample in age, gender, ethnicity, education, employment status, age at first treatment, and hospital admittance for psychiatric treatment, although those with non-psychotic conditions were more likely to be in the retest sample (66% vs 34%, 2 = 5.062, p = 0.024) compared to those with psychotic conditions. The characteristics of the sample are shown in Table 1. Participants had a mean age of 36 (range 18 to 70), 80% were female, the majority (87%) reported their ethnicity as White British, and 42% were in full- or part-time employment. The most common self-reported primary diagnoses were depression (34%) and bipolar disorder (31%). Forty six percent had been hospitalised for a mental health problem.
Development of the BACE v1 and v2
There were 172 barriers items in the 23 papers assessing barriers. This was reduced to 30 items following deletion and amalgamation by the research team. The team identified eight additional items from their knowledge of the research literature. Consequently the BACE v1, sent to the expert panel, had 38 items. Four of these items were deleted following feedback from the panel because they were viewed as ambiguous or already covered by a similar item. Two new items (20 and 21 in Table 2) were added at the expert panel’s suggestion making the BACE v2 a 36 item measure. Minor rewording was made in five items (revised items 3, 12, 16, 24 and 34 in Table 2), and two items were reworded for conceptual reasons (revised items 9 and 11 in Table 2). The research team designated 13 of the BACE v2 items as stigma-related, 23 as non-stigma related barriers, as shown in Table 2. One item (‘Difficulty taking time off work’) was viewed as potentially both instrumental and stigma-related because it risked disclosing the mental illness. A further two items (‘Concerns about the confidentiality of the information I share’ and ‘Dislike of talking about my feelings, emotions or thoughts’) were viewed as potentially both attitudinal and stigma-related. A decision was made to only designate items stigma-related if when there was no alternative potential designation for the barrier. The items that were designated stigma-related spanned anticipated discrimination in employment (items 6 and 33 in Table 2) and in relation to parenting (item 29), social stigma (items 9, 16 and 31), disclosure concerns (items 19 and 25), stereotypes (items 3, 14 and 21), internalised stigma (item 11) and stigma by association (item 26).
Distribution of the BACE treatment stigma subscale
BACE treatment stigma scores varied from 0 to 3 with a mean of 1.43 (sd 0.73). The BACE treatment stigma scale was normally distributed (Kolmogrov-Smirnov Z = 0.86, p = 0.454), therefore parametric statistics are appropriate for use with this scale.
The majority (22/36) of the BACE v2 items had weighted kappa values from 0.61 to 0.80 indicating substantial agreement between test and retest ; two items (12 and 29 of the BACE v2 shown in Table 2) had values above 0.8 indicating almost perfect agreement; 11 items had values between 0.41 and 0.60 indicating moderate agreement, and one (item 3, ‘Concern about being seen as weak for having a mental health problem’) had a kappa of 0.346 meaning fair reliability, but not reaching the pre-specified criterion of 0.4. Lin’s concordance statistic for the treatment stigma subscale was ρc = 0.816 exceeding the criterion of 0.70 for acceptable test-retest reliability. The Cronbach’s alpha value for the treatment stigma subscale was 0.89 indicating good internal consistency.
Twenty two participants gave free text answers in response to questions about other barriers. Content analysis the 36 additional barriers revealed 20 were already covered by the existing items, and 10 were proposed by one respondent only, thereby indicating good content validity. Provider delay and providers not responding to requests for help were mentioned as a barrier by four people, which suggests this is an aspect for further study. The hypothesised significant positive correlation between the BACE treatment stigma subscale and the SSRPH  was supported (r = 0.30, p = 0.001), as was the same hypothesised relationship between the BACE treatment stigma subscale and the Internalised Stigma of Mental Illness Scale  (r = 0.40, p < 0.001). Thus the subscale has convergent and hence construct validity.
Respondents gave a median overall evaluation rating of the BACE of 8 (IQR 7-9) on the 10-point scale, indicating a positive respondent opinion of the measure. The Flesch Reading Ease score for the BACE v3 was 78.8, indicating it is easier to read than documents at the general population level of 60-70. Its Flesch-Kincaid Grade Level was 5.9 indicating that it can be understood by the average 11 to 12 year-old.
Finalisation of the BACE v3
The research team deleted five items and amalgamated two items on the basis of item analysis and conceptual discussion, as well as making some final wording changes. Items 10 and 23 were removed because they were very highly correlated with another variable (rho > 0.7) and were highly correlated (rho > 0.5) with a further three variables. No other variables had this degree of inter-correlation. Items 22 and 32 were deleted because fewer than 10% of respondents rated the issue as a major barrier. Three other items (12, 17, 28, and 31) also met this criterion but were retained, the first two because they were relatively highly endorsed by non-White participants; the third because the literature suggests that informal care seeking is a common factor in delay in seeking professional care  and perhaps would be more evident in less unwell populations; and the fourth because concern about stigma from friends has been shown to be an important factor in young populations . Item 3 which did not meet the moderate test-retest reliability criterion was considered for removal but retained as its reliability level was ‘fair’  and because it was a relatively highly rated barrier (ranked 12/36). Two stigma-related items (9 and 26) were amalgamated with each other because only 11% rated the latter as a major barrier and because it had some conceptual similarity to the former. Item 36 was removed because it was considered to have a large conceptual overlap with item 25. Thus the BACE v3 has 30 items including 12 that are stigma-related. Following team discussion conceptual rewording was made to items 9, 29, 31 and 33 and minor rewording made to item 10. When asked for free text comments on the BACE, several respondents pointed out the need to have a ‘not applicable box’. These have now been added to the items referring to employment and to children. The scoring for the treatment stigma subscale was consequently amended from the mean rating to the mean of ratings for applicable items. This scoring method has been used successfully for other measures with varying numbers of applicable life domains, such as the DISC . This finalised version of the BACE can be seen in Additional file 1.
Prevalence of stigma-related and non-stigma-related barriers to access to care
The prevalence of stigma-related and non-stigma-related barriers to care-seeking for mental ill health reported by this sample is shown in Table 2. The top two barriers – ‘concern that it might harm my chances when applying for jobs’ (item 6) and ‘concern that I might be seen as a bad parent’ (item 16) - were both stigma-related with 39% and 38% reporting these as major barriers respectively and 89% and 88% experiencing them to some degree. The next most highly ranked barriers were difficulty taking time off work, being too unwell to ask for help, having had previous bad experiences, wanting to solve the problem on one’s own, and not wanting a mental health problem on one’s medical records with only the latter being a designated stigma-related barrier. Some types of stigma-related barriers were relatively rarely endorsed such as concern about it bringing shame or disapproval on one’s family and about what friends might think or say with 11% and 7% reporting these as a major barrier respectively.
Strengths and limitations
The main strengths of the study are the iterative detailed process of measure development and its relatively broad assessment of psychometric properties. The key strengths of the new measure include the comprehensiveness of the list of potential barriers; its format making it possible to use in all care settings and with all mental health conditions; that it encompasses care avoidance post- as well as pre-contact with services; and its incorporation of a barriers-based treatment stigma scale, encompassing more types of stigma than existing measures. A benefit of the measure is that it gives the flexibility to assess the extent of a barrier (mean score), and the frequency with which a barrier is experienced to any degree, and as a major barrier. The study is limited by its self-selected sample recruited through specific organisations, and one of the recruitment pathways was the website of an anti-discrimination programme (Time to Change) which may have increased the ratings of stigma-related barriers. The sample was also restricted to those with internet access. Men, Black and minority ethnic groups, and those with schizophrenia / schizoaffective disorder diagnoses were under-represented in the sample, although with only 42% in paid employment the sample is socioeconomically diverse. The psychometric and prevalence data may have been different had we used a sample who had never accessed care. Because the survey software was set up so as to require responses to all items, we have no information about the extent or patterns of missing data that would apply with the BACE. Such data would have provided useful additional information about the acceptability of the BACE and the content validity of its items. Our strategy of selecting items from existing barriers measures identified through a systematic review on stigma and healthcare seeking may have missed some non-stigma-related barriers, although the final measure contains 18 such items and so appears comprehensive. A further drawback is that, in the present study, we were not able to undertake a full psychometric assessment, which would include, for example, a factor analysis and examination of responsiveness. It is a limitation that the initial selection of items was performed by one researcher rather two. Lastly it is possible that a person who has more applicable life domains will have a greater opportunity to experience stigma and this could affect their treatment stigma score, although the use of the mean-of-applicable-items scoring method is likely to minimise any such effects.
The BACE may be used to identify key barriers to care experienced by people who currently use, or have recently used, secondary mental health services, and it has potential utility for use with general population samples. This may help to identify potential interventions to increase care seeking and service use and reduce the duration of untreated illness. It might also be used to assess change in barriers to care after the introduction of such interventions. The 12-item treatment stigma subscale may be used on its own, or as part of the 30-item BACE scale depending on the requirements of the particular research questions being addressed. The BACE v3 is the version recommended for use and is available, together with the BACE manual, from the authors.
Implications for future research
Further data is needed on the performance of the BACE v3 in a more representative sample, and one that is large enough for factor analysis. Our group is currently undertaking such work in the MIRIAD study (part of the SAPPHIRE Research Programme on Stigma and Discrimination in Mental Health, http://www.sapphire.iop.kcl.ac.uk). This study will also inform us about the psychometrics of the two additional items suggested by the participants of the present study (‘Having asked for help but not receiving it’ and ‘Having asked for help but having to wait a long time before receiving it’) and about two ethnicity-related barriers added because of that study’s particular focus (‘Concern that mental health staff will not understand cultural issues that are important to me’ and ‘Concern that I will be treated unfairly by mental health staff or services because of my ethnic background’). With severe mental illness, family members often play a major role in health care-seeking on behalf of the person affected . In the MIRIAD study we are using an adapted version of the BACE scale with informal caregivers and will report psychometric findings on the reliability and validity of this adaptation when data collection is complete. Further psychometric analysis is warranted to establish the responsiveness of the BACE and its treatment stigma subscale; and to explore the factor structure of the latter. There is a need for evidence about the scale’s performance in a community sample. As the participants in our study had accessed mental health care the level of barriers they reported is likely to be lower than that of those with mental health needs who have not accessed care, and the pattern of this latter group may be different. Further research is needed to elucidate levels and patterns of barriers in such populations. Lastly, the BACE is currently being used in the UK, with planned usage in Switzerland and Nepal, however, further evidence about its suitability for other international contexts would be welcome.
We have developed a new measure of barriers to access to care for mental ill health - the BACE – and have demonstrated preliminary evidence of its reliability, validity and acceptability. It was developed by systematically reducing 172 barrier items identified the extant literature to 38 (v1), then 36 (v2), then 30 (v3) to create a comprehensive self-complete measure assessing barriers to access to mental health care. Through this process we identified a broad spectrum of stigma-related barriers encompassing anticipated discrimination, social stigma, disclosure concerns, stereotypes, internalised stigma and stigma by association. The new measure incorporates a treatment stigma subscale for assessing the stigma associated with receiving mental health care. The BACE scale and its treatment stigma subscale were found to have good test-retest reliability, internal consistency, and content and construct validity. The measure was positively evaluated by participants and had readability levels appropriate for populations with mental illness. The study also provided preliminary evidence about the prevalence of stigma-related and non-stigma-related barriers to care-seeking for mental ill health reported by a sample of adults recently or currently using secondary mental health services. The most frequently endorsed barriers were of both types, although the top two were stigma-related. This attests to the importance of stigma as a key factor limiting access to mental health care [11–14, 60].
Thornicroft G: Most people with mental illness are not treated. Lancet. 2007, 370: 807-808. 10.1016/S0140-6736(07)61392-0.
Wittchen HU, Jacobib F: Size and burden of mental disorders in Europe-a critical review and appraisal of 27 studies. Eur Neuropsychopharmacol. 2005, 15: 357-376. 10.1016/j.euroneuro.2005.04.012.
Alonso J: Population level of unmet need for mental healthcare in Europe. Br J Psychiatry. 2007, 190: 299-306. 10.1192/bjp.bp.106.022004.
Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, Wang P, Wells KB, Zaslavsky AM: US prevalence and treatment of mental disorders, 1990 to 2003. N Engl J Med. 2005, 352: 2515-2523. 10.1056/NEJMsa043266.
Wang PS, Guilar-Gaxiola S, Alonso J, Angermeyer M, Borges G, Bromet E, Bruffaerts R: Use of mental health services for anxiety, mood and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2011, 370: 841-850.
Marshall M, Lewis S, Lockwood A, Drake R, Jones P, Croudace T: Association Between Duration of Untreated Psychosis and Outcome in Cohorts of First-Episode Patients: A Systematic Review. Arch Gen Psychiatry. 2005, 62: 975-983. 10.1001/archpsyc.62.9.975.
Morgan C, Mallett R, Hutchinson G, Leff J: Negative pathways to psychiatric care and ethnicity: the bridge between social science and psychiatry. Soc Sci Med. 2004, 58: 739-752. 10.1016/S0277-9536(03)00233-8.
O'Brien A, Fahmy R, Singh SP: Disengagement from mental health services: A literature review. Soc Psychiatry Psychiatr Epidemiol. 2009, 44: 558-568. 10.1007/s00127-008-0476-0.
Kessler RC, Berglund PA, Bruce ML, Koch JR, Laska EM, Leaf PJ, Manderscheid RW, Rosenheck RA, Walters EE, Wang PS: The prevalence and correlates of untreated serious mental illness. Health Serv Res. 2001, 36: 987-1007.
Van Beljouw I, Verhaak P, Prins M, Cuijpers P, Penninx B, Bensing J: Reasons and determinants for not receiving treatment for common mental disorders. Psychiatr Serv. 2010, 61: 250-257. 10.1176/appi.ps.61.3.250.
Schomerus G, Angermeyer MC: Stigma and its impact on help-seeking for mental disorders: what do we know?. Epidemiol Psichiatr Soc. 2008, 17: 31-37.
Thornicroft G: Stigma and discrimination limit access to mental health care. Epidemiol Psichiatr Soc. 2008, 17: 14-19.
Corrigan P: How stigma interferes with mental health care. Am Psychol. 2004, 59: 614-625.
Gulliver A, Griffiths K, Christensen H: Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010, 10: 113-10.1186/1471-244X-10-113.
Sirey JA, Bruce ML, Alexopoulos GS, Perlick DA, Raue P, Friedman SJ, Meyers BS: Perceived Stigma as a Predictor of Treatment Discontinuation in Young and Older Outpatients With Depression. Am J Psychiatry. 2001, 158: 479-481. 10.1176/appi.ajp.158.3.479.
Rusch N, Corrigan PW, Wassel A, Michaels P, Larson JE, Olschewski M, Wilkniss S, Batia K: Self-stigma, group identification, perceived legitimacy of discrimination and mental health service use. Br J Psychiatry. 2009, 195: 551-552. 10.1192/bjp.bp.109.067157.
Alvidrez J, Azocar F: Distressed women's clinic patients: preferences for mental health treatments and perceived obstacles. Gen Hosp Psychiatry. 1999, 21: 340-347. 10.1016/S0163-8343(99)00038-9.
Belloch A, Del VG, Morillo C, Carrio C, Cabedo E: To seek advice or not to seek advice about the problem: the help-seeking dilemma for obsessive-compulsive disorder. Soc Psychiatry Psychiatr Epidemiol. 2009, 44: 257-264. 10.1007/s00127-008-0423-0.
Boey KW: Help-seeking pattern of psychiatric outpatients in urban China. Int J Psychiatr Nurs Res. 1998, 4: 433-443.
Boey KW: Help-seeking preference of college students in urban China after the implementation of the "open-door" policy. Int J Soc Psychiatry. 1999, 45: 104-116. 10.1177/002076409904500203.
Chadda RK, Agarwal V, Singh MC, Raheja D: Help seeking behaviour of psychiatric patients before seeking care at a mental hospital. Int J Soc Psychiatry. 2001, 47: 71-78. 10.1177/002076400104700406.
Chandra A, Minkovitz CS: Stigma starts early: Gender differences in teen willingness to use mental health services. J Adolesc Health. 2006, 38: 754-
Eapen V, Ghubash R: Help-seeking for mental health problems of children: preferences and attitudes in the United Arab Emirates. Psychol Rep. 2004, 94: 663-667. 10.2466/pr0.94.2.663-667.
Eaton KM, Hoge CW, Messer SC, Whitt AA, Cabrera OA, McGurk D, Cox A, Castro CA: Prevalence of mental health problems, treatment need, and barriers to care among primary care-seeking spouses of military service members involved in Iraq and Afghanistan deployments. Mil Med. 2008, 173: 1051-1056.
Ey S, Henning KR, Shaw DL: Attitudes and factors related to seeking mental health treatment among medical and dental students. J Coll Student Psychother. 2000, 14: 23-39.
Fikretoglu D, Guay S, Pedlar D, Brunet A: Twelve month use of mental health services in a nationally representative, active military sample. Med Care. 2008, 46: 217-223. 10.1097/MLR.0b013e31815b979a.
Givens JL, Katz IR, Bellamy S, Holmes WC: Stigma and the acceptability of depression treatments among African Americans and whites. J Gen Intern Med. 2007, 22: 1292-1297. 10.1007/s11606-007-0276-3.
Goodman JH: Women's attitudes, preferences, and perceived barriers to treatment for perinatal depression. Birth. 2009, 36: 60-69. 10.1111/j.1523-536X.2008.00296.x.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL: Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004, 351: 13-22. 10.1056/NEJMoa040603.
Meltzer H, Bebbington P, Brusha T, Farrell M, Jenkins R, Lewis G: The reluctance to seek treatment for neurotic disorders. J Ment Health. 2000, 9: 319-327.
Meredith LS, Stein BD, Paddock SM, Jaycox LH, Quinn VP, Chandra A, Burnam A: Perceived barriers to treatment for adolescent depression. Med Care. 2009, 47: 677-685. 10.1097/MLR.0b013e318190d46b.
Meyer DF: Help-seeking for eating disorders in female adolescents. J Coll Student Psychother. 2001, 15: 36-
Nadeem E, Lange JM, Edge D, Fongwa M, Belin T, Miranda J: Does stigma keep poor young immigrant and U.S.-born Black and Latina women from seeking mental health care?. Psychiatr Serv. 2007, 58: 1547-1554. 10.1176/appi.ps.58.12.1547.
Nadeem E, Lange JM, Miranda J: Mental health care preferences among low-income and minority women. Arch Womens Ment Health. 2008, 11: 93-102. 10.1007/s00737-008-0002-0.
Olfson M, Guardino BA, Struening E, Schneier FR, Hellman BA, Klein D: Barriers to the treatment of social anxiety. Am J Psychiatry. 2000, 157: 521-527. 10.1176/appi.ajp.157.4.521.
Rhi B-Y, Ha K-S, Kim Y-S, Sasaki Y, Young D, Tai-Hwang W: The health care seeking behaviour of schizophrenic patients in six East Asian areas. Int J Soc Psychiatry. 1995, 41: 190-209. 10.1177/002076409504100304.
Saldivia S, Vicente B, Kohn R, Rioseco P, Torres S: Use of mental health services in Chile. Psychiatr Serv. 2004, 55: 71-76. 10.1176/appi.ps.55.1.71.
Warner CH, Appenzeller GN, Mullen K, Warner CM, Grieger T: Soldier attitudes toward mental health screening and seeking care upon return from combat. Mil Med. 2008, 173: 563-569.
Fisher EH, Turner JI: Orientation to seeking professional help: Development and research utility of an attitude scale. J Consult Clin Psychol. 2011, 35: 79-90.
Kuhl J, Jarkon-Horlick L, Morrissey RF: Measuring Barriers to Help-Seeking Behavior in Adolescents. J Youth Adolesc. 1997, 26: 637-650. 10.1023/A:1022367807715.
Komiya N, Good GE, Sherrod NB: Emotional openness as a predictor of college students' attitudes towards seeking psychological help. J Couns Psychol. 2000, 47: 138-143.
Vogel DL, Wade NG, Haake S: Measuring the self-stigma associated with seeking psychological help. J Couns Psychol. 2006, 53: 325-337.
Britt TW, Greene-Shortridge TM, Brink S, Nguyen QB, Rath J, Cox AL, Hoge CW, Castro CA: Perceived stigma and barriers to care for psychological treatment: Implications for reactions to stressors in different contexts. J Soc Clin Psychol. 2008, 27: 317-335. 10.1521/jscp.2008.27.4.317.
Kanter JW, Rusch LC, Brondino MJ: Depression self-stigma: a new measure and preliminary findings. J Nerv Ment Dis. 2008, 196: 663-670. 10.1097/NMD.0b013e318183f8af.
Pepin R, Segal DL, Coolidge FL: Intrinsic and extrinsic barriers to mental health care among community-dwelling younger and older adults. Aging Ment Health. 2009, 13: 769-777. 10.1080/13607860902918231.
Schomerus G, Matschinger H, Angermeyer MC: The stigma of psychiatric treatment and help-seeking intentions for depression. Eur Arch Psychiatry Clin Neurosci. 2009, 25: 298-306.
Ritsher JB, Otilingam PG, Grajales M: Internalized stigma of mental illness: Psychometric properties of a new measure. Psychiatry Res. 2003, 121: 31-49. 10.1016/j.psychres.2003.08.008.
Golberstein E, Eisenberg D, Gollust SE: Perceived stigma and mental health care seeking. Psychiatr Serv. 2008, 59: 392-399. 10.1176/appi.ps.59.4.392.
SPSS Inc.: SPSS for Windows, Rel 15.0. 2006, SPSS Inc, Chicago
StataCorp: Stata Statistical Software: Release 9.2. 2005, StataCorp LP, College Station, TX
Landis JR, Koch GC: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.
Lin LIK: A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989, 45: 255-268. 10.2307/2532051.
Nunnally J, Bernstein JC: Psychometric theory. 1994, McGraw Hill, New York
Guyatt GH, Feeny DH, Nunnally J: Measuring health-related quality of life. Ann Intern Med. 1993, 118: 622-629.
Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2002, Oxford Medical Publications, Oxford, 3
Flesch R: The Art of Readable Writing. 1974, Harper & Row, New York
Pescosolido BA, Boyer CA: How do people come to use mental health services? Current knowledge and changing perspectives. A handbook for the study of mental health: Social contexts, theories and systems. Edited by: Horowitz AV, Scheid TL. 1999, Cambridge University Press, New York
Thornicroft G, Brohan E, Rose D, Sartorius N, the INDIGO study group, the INDIGO study group: Global pattern of experienced and anticipated discrimination against people with schizophrenia. Lancet. 2009, 373 (9661): 408-415. 10.1016/S0140-6736(08)61817-6.
Clement S, Brohan E, Thornicroft G: Help-seeking and stigma: A broader view. Psychologist. 2009, 22: 192-193.
Tanskanen S, Morant N, Hinton M, Lloyd-Evans B, Crosby M, Killaspy H, Raine R, Pilling S, Johnson S: Service user and carer experiences of seeking help for a first episode of psychosis: a UK qualitative study. BMC Psychiatry. 2011, 11: 157-10.1186/1471-244X-11-157.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/12/36/prepub
We thank the participants who took part in our study, the organisations that facilitated recruitment: the South East Hub of the Mental Health Research Network; Rethink; the Mental Health Foundation; and Time to Change, and our expert panel. This paper presents independent research commissioned by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research scheme (RP-PG-0606-1053). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. GT and SLH are also funded through a NIHR Specialist Mental Health Biomedical Research Centre at the Institute of Psychiatry, King’s College London and the South London and Maudsley NHS Foundation Trust.
The authors declare that they have no competing interests.
SC designed and led the study, drafted the versions of the questionnaire, conducted the main analysis and drafted the manuscript. EB contributed to study design, questionnaire development, and data interpretation, and collected the data and performed the statistical analysis of the test-retest data test-retest analyses. DJ contributed to the literature review and data interpretation. CH, SLH and GT contributed to study design, questionnaire development, and data interpretation. All authors critically revised the draft manuscript, and read and approved the final manuscript.
Electronic supplementary material
About this article
Cite this article
Clement, S., Brohan, E., Jeffery, D. et al. Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health. BMC Psychiatry 12, 36 (2012). https://doi.org/10.1186/1471-244X-12-36