Expectations, experiences and attitudes of patients and primary care health professionals regarding online psychotherapeutic interventions for depression: protocol for a qualitative study
© Montero-Marin et al.; licensee BioMed Central Ltd. 2013
Received: 20 April 2012
Accepted: 13 February 2013
Published: 20 February 2013
In the year 2020, depression will cause the second highest amount of disability worldwide. One quarter of the population will suffer from depression symptoms at some point in their lives. Mental health services in Western countries are overburdened. Therefore, cost-effective interventions that do not involve mental health services, such as online psychotherapy programs, have been proposed. These programs demonstrate satisfactory outcomes, but the completion rate for patients is low. Health professionals’ attitudes towards this type of psychotherapy are more negative than the attitudes of depressed patients themselves. The aim of this study is to describe the profile of depressed patients who would benefit most from online psychotherapy and to identify expectations, experiences, and attitudes about online psychotherapy among both patients and health professionals that can facilitate or hinder its effects.
A parallel qualitative design will be used in a randomised controlled trial on the efficiency of online psychotherapeutic treatment for depression. Through interviews and focus groups, the experiences of treated patients, their reasons for abandoning the program, the expectations of untreated patients, and the attitudes of health professionals will be examined. Questions will be asked about training in new technologies, opinions of online psychotherapy, adjustment to therapy within the daily routine, the virtual and anonymous relationship with the therapist, the process of online communication, information necessary to make progress in therapy, process of working with the program, motivations and attitudes about treatment, expected consequences, normalisation of this type of therapy in primary care, changes in the physician-patient relationship, and resources and risks. A thematic content analysis from the grounded theory for interviews and an analysis of the discursive positions of participants based on the sociological model for focus groups will be performed.
Knowledge of the expectations, experiences, and attitudes of both patients and medical personnel regarding online interventions for depression can facilitate the implementation of this new psychotherapeutic tool. This qualitative investigation will provide thorough knowledge of the perceptions, beliefs, and values of patients and clinicians, which will be very useful for understanding how to implement this intervention method for depression.
KeywordsDepression Online psychotherapy Internet-based treatment Protocol Qualitative study
Reports from the World Health Organization say that depression will cause the second highest level of disability worldwide by the year 2020 . It is also known that 25% of the population will experience depression symptoms at some point in their lives . Studies confirm that 25-35% of patients visiting primary care suffer from a psychiatric disorder and that more that 80% of these cases are minor psychiatric disorders, mainly depression and anxiety . It is known that family physicians only refer 5-10% of the psychiatric pathologies that they detect to mental health services . Despite this low referral rate, mental health services in Western countries are overburdened. Given the high prevalence of minor psychiatric disorders, health officials worldwide assume that it is not possible to count on the availability of mental health professionals or economic resources to meet this need, and the situation will become even more unfavourable in the near future . For this reason, cost-effective alternatives are being proposed for the treatment of minor psychiatric disorders in general, and depression in particular, that do not involve (or only minimally involve) mental health services. The therapeutic solutions that are most frequently investigated are brief psychotherapies that can be administrated from a personal computer, such as conflict resolution therapy , bibliotherapy , self-help programs  and computer-assisted psychotherapy programs .
The term “computer-assisted psychotherapy” is used to refer to any psychotherapy program (all programs currently available use cognitive-behavioural therapy) that uses the patient’s responses to perform some type of decision-making about treatment . This term excludes videoconferences and self-help programs that involve exclusively bibliotherapy, chats, or support groups, among other approaches. Computer programs decrease the work of psychotherapists by more than 80% but do not eliminate it completely. In fact, it has been shown that treatment programs with no human intervention are associated with a higher frequency of dropouts, so their effectiveness is lower. Patients tend to access therapy from a home computer and usually complete short sessions, approximately 20 minutes long, at least once a week for 3–6 months . Research has assessed the effectiveness of computer-assisted psychotherapy for treating psychiatric disorders as varied as anxiety, depressive disorders, alcohol abuse, and psychosomatic illnesses [11–13]. Recent research on the cost-effectiveness of computer-assisted psychotherapy has yielded very satisfactory results [14, 15].
In the specific case of depression, studies show that computer-assisted psychotherapy is effective for the treatment of light and moderate depression . This result has led the National Institute for Health and Clinical Excellence of the British National Health Service to support the widespread use of a computer-assisted psychotherapy program (“Beating the Blues”) in the treatment of depression . Other studies show that computer-assisted psychotherapy is very effective, indicating that the program could be viable not only at the primary care level but also in the mental health services context. Computer-assisted psychotherapy could be recommended as a first treatment step for self-help in treating depression and anxiety before visiting a psychiatrist or psychologist . Recent studies have evaluated computer-assisted psychotherapy programs, such as “Blues Begone”, in which there is no psychotherapist present and the program can be administered completely by the patient . The effectiveness of this type of program is also very high, and its use has been evaluated through naturalistic studies and randomised trials [17, 18]. The effect size is 0.5 (Cohen’s d) when analysed by intention to treat and 1 (Cohen’s d) when only the patients who complete the program are analysed. In addition, effectiveness is maintained 6 months after finishing the therapy program . Other computer-assisted intervention models are being tested in which treatment is delivered by a therapist in real time via the Internet, and the results of these tests are positive in terms of effectiveness and acceptability .
This type of therapy produces a very positive expectation in patients and a high degree of satisfaction [20, 21]. However, there are some limitations to its systematic use. The completion rate for patients in clinical trials is 56%. In most cases, patients withdraw for personal reasons, not because of problems with the technology or the social environment. Interestingly, the attitudes of professionals towards this type of psychotherapy are more negative than the attitudes of patients themselves [20, 21]. There are few previous studies on the acceptability of computer-based psychotherapy, particularly in the primary care setting .
The first objective of this research is to describe the profile of depressed patients who would benefit the most from online-assisted psychotherapy. The second objective is to identify expectations, experiences, and attitudes among both patients and health professionals that may serve as barriers to or facilitators of online-assisted psychotherapy by considering the types of information that they require throughout the therapeutic process for adequate intervention development.
A qualitative study in the context of a randomised controlled trial on the effectiveness of an online psychotherapeutic intervention for depression is proposed. Through in-depth interviews , first, an attempt will be made to understand the experiences of depressed patients with online psychotherapy interventions, the reasons why people decided to end treatment, and the expectations of those who are not treated (considered separately to avoid the possible additional therapeutic effect of the interviews). Second, the research will aim to understand the attitudes and experiences of family physicians, department heads, and managers regarding the implementation of this type of therapy. Focus groups  will also be formed to explore dynamic interactions in light of cultural characteristics and concrete values that can be the basis for participants’ views and preferences. In this way, qualitative information will be obtained from a collective and group vision that only emerges from individual interviews with some difficulty [23–25]. This methodological triangulation will increase the consistency and rigor of the study by combining multiple techniques. By placing emphasis on different aspects or perspectives of analysis, these techniques complement and balance each other . The project has been approved by the Regional Ethics Committee of Aragón (Spain).
The study will be performed in the Spanish autonomous communities of Andalucía, Aragón, and Baleares. The patients will be recruited during visits to a primary care physician, and diagnosis will be established using the MINI Neuropsychiatric Interview in Spanish . All participants chosen will report depressive symptoms as listed in the ICD-10 criteria, with Beck Depression Inventory (BDI) scores indicating depression of low severity (i.e., scores of 14–19) . Family physicians, department heads, and managers will be chosen for the implementation of the program prepared for the randomised controlled trial. The patients and health professional participants will be selected while considering the variables that maintain homogeneity and discursive heterogeneity regarding the objectives of the study, such as age, gender, residential setting, affinity for technology, and opinion of other types of interventions or therapies. The department heads and managers, as a minority group, will be chosen only based on whether their workplace is rural or urban. When recruiting patients, we will exclude those patients from the study who are younger than 18 or older than 65 years old, immigrants with language difficulties that prevent them from completing the program, affected by serious psychiatric disorders (e.g., psychosis, dementia), or demonstrate clear technophobia during the interview. Through purposive sampling, an attempt will be made to capture rich and varied information in agreement with the goals of the study , thus optimising the representation of participants’ opinions.
A preliminary analysis will allow us to progress though the interviews in an iterative manner until the data are saturated; that is, until the new information becomes redundant and provides no new perspectives. We hope that this will occur after approximately 10 interviews in each of the four groups (depressed patients who completed online psychotherapy; depressed patients who decided to discontinue online psychotherapy treatment; depressed patients who did not receive treatment online; and family physicians, department heads, and managers). After the interviews, four focus groups will be conducted, each consisting of between eight and ten subjects. An attempt will be made to ensure the adequate representation of the stratification variables considered but with intergroup heterogeneity and intragroup homogeneity to allow the groups to be formed appropriately [24, 30]. The necessary information to establish the appropriate stratifications will be collected before beginning the interviews and focus groups.
The researchers involved in the study will receive training in qualitative social research procedures, in-depth interviews, and focus groups . Topics to be addressed in both the individual interviews and focus groups will be discussed by the team of researchers and will guide the interviewers and moderators in the same direction. In-depth interviews will be carried out by a single interviewer, who will indirectly raise the objectives of the study, questioning interviewees about topics in an open and progressive way. The interviewer will also explain the need for recording the session (only audio) and will take notes about non-verbal language elements. The focus groups will be moderated by an interviewer, and another person from the research team may be present as an observer. The role of the moderator will be to indirectly explain the objectives of the study, introduce the topics of interest, and direct the group dynamics to encourage dialogue and participation. The function of the observer is limited to collecting field notes to provide additional information to the verbal data obtained, such as information related to non-verbal language, responses to the moderator’s interventions, and contextual aspects. The indirect introduction of the objectives will enable us to analyse the participants’ natural approach to the issues of interest.
-Information technology skills
-Online vs. in person therapy
-Identification with the program
-Barriers and facilitators
-Changes in symptoms
-Anonymous and virtual relationship
-Reflectivity of responses
-Information and preferences
-Normalisation in primary care
We will ensure the confidentiality and anonymous nature of the study for potential participants. All of the sessions will be audio taped with the consent of the participating subjects, and the material will be transcribed verbatim. Both the interviews and the focus groups will last approximately 60–90 minutes. The two researchers responsible for the focus groups will meet after each session to clarify and exchange views and field notes. This information will be analysed with data from the audio recordings and notes .
The body of text (verbatim) will consist of recordings transcribed literally, supplemented by notes from observations and comments from interviewers/moderators and collaborators. The interviewers/moderators will verify the transcripts to guarantee the accuracy of the data. Final validation will be performed by inviting the participants to read and discuss the transcribed content .
The preliminary analysis will begin after the first interviews and progress through the interviews iteratively to confirm or discount the topics found . The transcriptions and notes will be reread and analysed by two independent social researchers who are experts in qualitative content analysis, using a vertical, interpretive, emergent, and non-frequency-based approach [22, 38]. Through thematic analysis, supported by the initial guide for content specification as the first framework for approximation and using the constant comparative method from fundamental theory, key units of meaning will be identified that enable us to deconstruct every sentence . The information contained in the generated text segments will be compared and grouped through open coding until a common conceptual denomination for all segments of text that share the same thematic unit is reached . Provisional interpretations will be made to highlight the characteristics and relationships of the emerging codes generated, which will form new categories as a result of their gradual fusion [39–41]. These broader categories, defined in an exclusive manner based on agreement among the researchers, will make the conceptual structure denser until a parsimonious solution can be reached. Cases that cannot be classified will be actively sought out during the analysis, and the emerging categories will be redefined in response to these cases [42, 43].
The information gathered from focus groups will be analysed using the model of sociological analysis [44, 45]. In this technique, the reading and organisation of data are not based on fragmentation of the text but on the interpretation of the different discursive positions among the participants and the identification of the explanatory axes of their interventions . The themes and patterns will be identified and coded by two independent researchers, taking into account the context in which the interventions took place. Each step towards configuring the potential explanatory axes will require an iterative reading to validate and confirm the interpretation of new findings, ensuring the credibility of the process by reviewing the data again from the beginning . At first, the material from different groups will be analysed separately (intra-group analysis), but later, it will be regrouped and pooled to compare the relevant themes (inter-group analysis). The precision of the analysis will be increased by highlighting the consistent results in all groups, and special attention will be given to “sensitive moments” in the interaction as indicators of important discussions. The whole process will be triangulated between the two researchers, and differences will be resolved through discussion.
To manage the data, we will use the analysis program MAXQDA 2007. The results of the thematic content analysis of the interviews and the interpretation of the main explanatory axes in the focus groups will be presented alongside the empirical references in the text, selecting the most representative verbatim segments for use as examples. The researchers will develop a list of concepts identified in the interviews and focus groups and create conceptual diagrams that increase understanding and comparability. The final coding framework will be discussed with the main researcher and therapy coordinator so that all stakeholders agree.
Online computer-assisted psychotherapy seems to be an effective and cost-effective approach to treating mild to moderate depression [14, 16–18]. In fact, referring patients to computer-assisted psychotherapy after consultation in primary care could relieve some of the burden on mental health services, which are presently unable to meet the demand for mental health care . Knowledge of the expectations, experiences, and attitudes of those involved in the therapeutic process is very important if this new form of treatment is to be implemented successfully. To date, research on these issues has been restricted to the perspective of the patient [32–35] without adequately addressing the perspectives of health officials who would be involved in recommending this type of intervention. Interestingly, these professionals show greater resistance to the use of this kind of intervention than the patients themselves do. The majority of patients who discontinue computer-assisted psychotherapy treatment do so for personal reasons and not because of problems with the technology or the social environment [20, 21]. The changes introduced to clinical practice and the doctor-patient relationship by computer-assisted psychotherapy make it important to identify the profile of patients who could benefit most from this therapeutic approach. In addition, it is very important to understand the difficulties that may arise during the therapeutic process to address them and to identify facilitators for completing the treatment.
Qualitative research methods provide a thorough understanding of the perceptions, beliefs, and values of the people being studied, and they are very useful in the health field [48, 49]. These methods provide the opportunity to explore the points of view of both patients and medical personnel involved in the therapeutic process, thus helping researchers to understand them . This study does not quantify the hypothetical positive or negative aspects of online therapeutic intervention or the correlations between opinions and other types of variables [25, 50]. Through this research, an attempt is made to understand the values and experiences of the participants in the context of the study, which are valid to the extent that they contribute to the knowledge and understanding of the therapeutic reality of this type of intervention.
Jesús Montero-Marín, Javier García-Campayo, Miquel Roca, Antoni Serrano-Blanco, Margalida Gili, Fermín Mayoral, Juan V. Luciano, Yolanda López del Hoyo and Bárbara Oliván belong to the REDIAPP (Research Network on Preventative Activities and Health Promotion, RD06/0018/0017).
This project is funded by the Instituto de Salud Carlos III [Carlos III Health Institute] (PI10/01083) and the Ministerio de Ciencia e Innovación [Ministry of Science and Innovation] (PSI2010-17563). The publication of this document was made possible within the framework of collaboration designed by the Research Network on Preventative Activities and Health Promotion (REDIAPP).
- World Health Organization: The global burden of disease. 2001, Géneve: WHOGoogle Scholar
- Sartorius N, Goldberg D, Girolamo G: Silva JA Ce, Lecrubier Y, Wittchen HU: Psychological disorders in general medical settings. 1990, New York: Hogrefe & Huber Publishers,Google Scholar
- Goldber D, Huxley P: Enfermedad mental en la comunidad. [Mental illness in the community]. 1990, Madrid: NievaGoogle Scholar
- Agüera LF, Reneses B, Muñoz P: Enfermedad mental en atención primaria. [Mental illness in primary care]. 1996, Madrid: FlasGoogle Scholar
- Lehtinen V, Riikonen E, Latineen E: Promotion of mental health on the European agenda. Report. Finnish ministry of. Social Affairs and Health: Dpt for Prevention and Promotion. 2000Google Scholar
- Cuijpers P, van Straten A, Warmerdam L: Problem solving therapies for depression: a meta-analysis. Eur Psychiatry. 2007, 22: 9-15. 10.1016/j.eurpsy.2006.11.001.View ArticlePubMedGoogle Scholar
- Cuijpers P: Bibliotherapy in unipolar depression: a metaanalysis. J Behav Ther Exp Psychiatry. 1997, 28: 139-147. 10.1016/S0005-7916(97)00005-0.View ArticlePubMedGoogle Scholar
- Bower P, Richards P, Novell K: The clinical and cost-effectiveness of self-help treatment for anxiety and depressive disorders in primary care: a systematic review. Br J Gen Pract. 2001, 51: 838-845.PubMedPubMed CentralGoogle Scholar
- Kaltenthaler E, Parry G, Beverley C, Ferriter M: Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry. 2008, 193: 181-184. 10.1192/bjp.bp.106.025981.View ArticlePubMedGoogle Scholar
- Marks IM, Cavanagh K, Gega L: Computer-aided psychotherapy: revolution or bubble?. Br J Psychiatry. 2007, 191: 471-473. 10.1192/bjp.bp.107.041152.View ArticlePubMedGoogle Scholar
- Andersson G: Using the Internet to provide cognitive behaviour therapy. Behav Res Therapy. 2009, 47: 175-180. 10.1016/j.brat.2009.01.010.View ArticleGoogle Scholar
- Craske MG, Rose RD, Lang A, Welch SS, Campbell-Sills L, Sullivan G: Computer-assisted delivery of cognitive behavioral therapy for anxiety disorders in primary-care settings. Depress Anxiety. 2009, 26: 235-242. 10.1002/da.20542.View ArticlePubMedPubMed CentralGoogle Scholar
- Titov N: Status of computerized cognitive behavioural therapy for adults. Aust N Z J Psychiatry. 2007, 41: 95-114. 10.1080/00048670601109873.View ArticlePubMedGoogle Scholar
- McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, Ilson S: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004, 185: 55-62. 10.1192/bjp.185.1.55.View ArticlePubMedGoogle Scholar
- McCrone P, Marks IM, Mataix-Cols D, Kenwright M, McDonough M: Computer-aided self-exposure therapy for phobia/panic disorder: a pilot economic evaluation. Cogn Behav Ther. 2009, 18: 1-9.Google Scholar
- Learmonth D, Rai S: Taking computerized CBT beyond primary care. Br J Clin Psychol. 2008, 47: 111-118. 10.1348/014466507X248599.View ArticlePubMedGoogle Scholar
- Purves DG, Bennett M, Wellman N: An open trial in the NHS of Blues Begone: a new home based computerized CBT program. Behav Cogn Psychother. 2009, 37: 541-551. 10.1017/S1352465809990282.View ArticlePubMedGoogle Scholar
- Cavanagh K, Shapiro DA, Van Den Berg S, Swain S, Barkham M, Proudfoot J: The effectiveness of computerized cognitive behavioural therapy in routine care. Br J Clin Psychol. 2006, 45: 499-514. 10.1348/014466505X84782.View ArticlePubMedGoogle Scholar
- Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, Sharp DJ, Araya R, Hollinghurst S, Peters TJ: Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet. 2009, 374: 628-634. 10.1016/S0140-6736(09)61257-5.View ArticlePubMedGoogle Scholar
- Waller R, Gilbody S: Barriers to the uptake of computerized cognitive behaviour therapy: a systematic review of the quantitative and qualitative evidency. Psychol Med. 2009, 39: 705-712. 10.1017/S0033291708004224.View ArticlePubMedGoogle Scholar
- Kaltenhthaler E, Sutcliffe E, Parry G, Beverley C, Rees A: The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med. 2008, 38: 1521-1530. 10.1017/S0033291707002607.View ArticleGoogle Scholar
- Vallés MS: Técnicas cualitativas de investigación social. [Qualitative techniques of social research.]. 2003, Madrid: Síntesis SociologíaGoogle Scholar
- Ibáñez J: Más allá de la sociología. El grupo de discusión: técnica y crítica. [Beyond sociology. The focus group: techniques and criticism.]. 1986, Madrid: Siglo XXIGoogle Scholar
- Callejo J: El grupo de discusión: introducción a una práctica de investigación. [The focus group: introduction to a research practice.]. 2001, Barcelona: ArielGoogle Scholar
- Calderón C, Rotaeche R, Carrera C, Larrañaga M, Merino J: Aproximación cualitativa a las actitudes y expectativas de los médicos en el proceso de informatización de la atención primaria. In Qualitative approximation to the attitudes and expectations of doctors in the process of computerization of primary care. Edited by Mercado FJ, Gastaldo D, Calderón C, comp. Paradigmas y diseños de la investigación cualitativa en salud. [Paradigms and designs in qualitative research in health.]. 2002, Guadalajara: Universidad de Guadalajara,Google Scholar
- Denzin N, Lincoln Y: Introduction: entering the field of qualitative research. Handbook of qualitative research. Edited by: Denzin N, Lincoln Y. 1994, California: SageGoogle Scholar
- Ferrando L, Franco A, Bobes J: MINI international neuropsychiatric interview. 1998, Madrid: Instituto IAPGoogle Scholar
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4: 53-63.View ArticleGoogle Scholar
- Kotzeva A, Sola I, Carrasco JM, Díaz P, Gracia FJ, Calderón E, de Gaminde I, Estrada MD, Martínez F, Orrego C, Rotaeche R, Salcedo F, Velazquez P, Alonso-Coello P: Perceptions and attitudes of clinicians in Spain toward clinical practice guidelines and grading systems: a protocol for a qualitative study and a national survey. BMC Health Serv Res. 2010, 10: 328-10.1186/1472-6963-10-328.View ArticlePubMedPubMed CentralGoogle Scholar
- Krueger RA: Is it a focus group? tips on How to tell. J Wound Ostomy Continence Nurs. 2006, 33 (4): 363-366. 10.1097/00152192-200607000-00003.View ArticlePubMedGoogle Scholar
- Brown JB: The Use of focus groups in clinical research. Doing qualitative research. Edited by: Crabtree BF, Miller WL. 1999, Thousand Oaks, CA: Sage, 109-124.Google Scholar
- Beattie A, Shaw A, Kaur S: Primary-care patients expectations and experiences of online cognitive behavioural therapy for depression: a qualitative study. Health Expect. 2009, 12: 45-59. 10.1111/j.1369-7625.2008.00531.x.View ArticlePubMedGoogle Scholar
- Barney LJ, Griffiths KM, Banfield MA: Explicit and implicit information needs of people with depression: a qualitative investigation of problems reported on an online depression support forum. BMC Psychiatry. 2011, 11: 88-10.1186/1471-244X-11-88.View ArticlePubMedPubMed CentralGoogle Scholar
- Gerhards SAH, Abma TA, Arntz A, de Graaf LE, Evers SMAA, Huibers MJH, Widderswoven GAM: Improving adherence and effectiveness of computerised cognitive behavioural therapy without support for depression: a qualitative study on patient experiences. J Affect Disord. 2011, 129: 117-125. 10.1016/j.jad.2010.09.012.View ArticlePubMedGoogle Scholar
- Bendelin N, Hesser H, Dahl J, Carlbring P, Zetterqvist K, Andersson G: Experiences of guided Internet-based cognitive-behavioural treatment for depression: a qualitative study. BMC Psychiatry. 2011, 11: 107-10.1186/1471-244X-11-107.View ArticlePubMedPubMed CentralGoogle Scholar
- Morse JM, Barret M, Mayan M, Olson K, Spiers J: Verification strategies for establishing reliability and validity in qualitative research. IJQM. 2002, 1: 13-22. http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/4603/3756,Google Scholar
- Pope C, Ziebland S, Mays N: Analysing qualitative data. Br Med J. 2000, 320: 114-116. 10.1136/bmj.320.7227.114.View ArticleGoogle Scholar
- Piñuel JL: Epistemología, metodología y técnicas del análisis de contenido [Epistemology, methodology, and content analysis techniques]. Estudios de Sociolingüística. 2002, 3: 1-42.Google Scholar
- Strauss A, Corbin J: Basics of qualitative research. 1998, London: Sage, 2Google Scholar
- Glaser BG, Strauss AL: The discovery of grounded theory. 1967, Chicago: AldineGoogle Scholar
- Strauss A: Qualitative analysis for social scientists. 1987, Cambridge: Cambridge University PressView ArticleGoogle Scholar
- Berg BL: Qualitative research methods for the social sciences. 2007, Boston, MA: Allyn and Bacon, 6Google Scholar
- Silverman D: Doing qualitative research: a practical handbook. 2005, Los Angeles: SAGE, 2Google Scholar
- Alonso LE: La mirada cualitativa en sociología. Una aproximación interpretativa. [A qualitative approach to sociology. An interpretative approach]. 1998, Madrid: Editorial FundamentosGoogle Scholar
- Phillips N, Hardy C: Discourse analysis. Investigating processes of social construction. 2002, Thousand Oaks CA: SageGoogle Scholar
- Conde F: El análisis de la información en la investigación cualitativa. [Information analysis in qualitative research]. Introducción a la investigación cualitativa. Máster de investigación en atención primaria. [Introduction to qualitative research: research masters in primary care]. Edited by: Calderón C, Conde F, de Sanmamed MJ F, Monistrol O. 2004, Barcelona: semFYC, UAB, Fundació Dr. RobertGoogle Scholar
- Miller WL, Crabtree BF: The dance of Interpretation. Doing qualitative research. Edited by: Crabtree BF, Miller WL. 1999, Thousand Oaks, CA: Sage, 127-143.Google Scholar
- Pope C, Mays N: Qualitative research in healthcare. 2000, London: BMJ BooksGoogle Scholar
- Murphy E, Dingwall R: Qualitative methods and health policy research. 2003, New York: Aldine de GruyterGoogle Scholar
- Mercado FJ, Gastaldo D, Calderón C: Investigación cualitativa en salud en Iberoamérica. [Qualitative research in health in Iberoamerica]. 2002, Guadalajara: Universidad de GuadalajaraGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/13/64/prepub