- Study protocol
- Open Access
Assessing the efficacy of a culturally adapted cognitive behavioural internet-delivered treatment for depression: protocol for a randomised controlled trial
BMC Psychiatry volume 18, Article number: 53 (2018)
Depression is the principal cause of disability in the world. High prevalence rates of depression in general populations and college students have been found worldwide and in various cultural groups. Low-intensity cognitive behavioural internet-delivered treatment has demonstrated efficacy in high-income-countries (HICs). However little is known of their potential for adaptation and efficacy in low and middle-income countries.
Study (1) involves the cultural adaptation of the Space from Depression cognitive-behaviour internet-delivered programme with an asynchronous support for depressive symptoms. This includes initial researcher/clinician adaptation and the integration of cultural assessment feedback of the programme by a panel of experts and users through the theoretically-based Cultural Relevance Questionnaire (CRQ). Study (2) describes the implementation of the culturally adapted intervention using a randomised controlled trial methodology. The efficacy trial will include an active treatment group and a waiting-list control group of participants meeting eligibility criteria (mild to moderate depression symptoms). The active condition will consist of 7 weekly modules of internet-delivered cognitive behavioural therapy (iCBT) Space from Depression, with post-session feedback support. The primary outcome will be the Patient Health Questionnaire (PHQ-9). The study also involves collection of client reported significant events and client satisfaction with the internet-delivered treatment. Data will be collected at baseline and at post-treatment (week 7), and at follow-up (week 20/3 months). Analysis will be conducted on the intention-to-treat basis.
The study seeks to establish a theoretically robust methodology for culturally adapting internet-delivered interventions for mental health disorders and to evaluate the efficacy of a culturally adapted internet-delivered treatment for depression in Colombia, with support. The study will be a first contribution to a method for culturally adapting internet-delivered interventions and also a first to examine the efficacy of such an adapted intervention in Latin America.
Clinical trials NCT03062215. Retrospectively registered 14th February 2017.
High rates of depression have been reported throughout the world [1, 2]. For instance, a 12-month prevalence rate has been estimated in the U.S. at 9.5% and in Europe at 8.5% of the population [3, 4]. In Colombia, 12-month prevalence is between 6.2% and 12.1% [5,6,7,8]. The Colombian National Mental Health Survey (2015) has estimated point prevalence of mild to moderate depressive symptoms at 15.6% and severe depressive symptoms at 4.2% of adults. About 50% of the population does not have access to health services , while the majority of the population with mental health problems do not have adequate insurance coverage .
Despite the necessity to implement psychological interventions in Latin America, there are few studies in this field . More so, treatments are mostly pharmacological, and evidence-based psychological treatments are rarely used. Furthermore, treatments in low and middle income countries (LMICs) are implemented without considering cultural context: very little research has investigated culturally adapted treatments , while there is even less research about internet-delivered treatments . Internet delivered psychological treatment may be a suitable alternative to make evidence-based treatments available, especially when nearly 54% of the population use the internet .
Depressive symptoms in college students
Depressive disorders have shown to be more frequent among college students in comparison with the general population . For instance, a systematic review shows a weighted mean prevalence of depression symptoms in college students of 30.6% . These rates are comparable to reports from Latin America [17,18,19,20]. In Colombia one study reported high prevalence of depression symptoms (30%) in students . Another recent study showed 36.2% prevalence of depression symptoms in a university sample .
Several variables have been associated with vulnerability of college students to depression: changes in lifestyle related to poor sleep habits, eating disorders, economic stressors and family problems [16, 23]. In spite of the high rates of depression within the college population, research studies and treatment for depression in Colombia have received little attention . Recently, a World Mental Health survey reports that only 16.4% of students received treatment for their mental disorder, while in lower-middle/low income countries it was 6.7% .
Psychological treatments for depression have shown better outcomes in comparison with waiting list or placebo and combined treatment is more effective than pharmacotherapy alone [26, 27]. Boumparis, Karyotaki  found that psychological treatments can enhance positive affect and decrease negative affect in depression, contributing to better outcomes. A recent meta-analysis showed that Cognitive Behaviour Therapy (CBT) has been extensively researched and it has been demonstrated to be effective for depression .
Low intensity internet-delivered treatment
Low-intensity internet-delivered treatment involves self-guidance, where the content, including CBT techniques that are typically used in face-to-face therapy are delivered using text, pictures, animations, audio files and videos. This type of intervention is highly structured, it involves psychoeducation, activities and supplementary resources, such as a supporter contact via asynchronous message .
Internet-delivered interventions have an established empirical base for major depression , sub-threshold depression , and in maintenance treatments [33,34,35]. For instance, a systematic review of computer-based interventions for depression found a mean effect size of d = 0.78 for the reduction of depressive symptoms post-treatment . A recent review showed how face-to-face psychotherapy and internet-delivered therapy had similar effects .
Internet-interventions for depression are available in many languages. Research from Spanish language versions including López-del-Hoyo, Olivan  and Montero-Marín, Araya  reported positively on the effectiveness of a CBT-based internet-delivered programme for depression. A recent four-year descriptive, naturalistic study monitoring a web-based CBT treatment developed and researched in Mexico indicated that the intervention was useful for depressive symptoms . A feasibility study in Chile found an online treatment to be beneficial, acceptable and feasible .
For the most part, internet interventions for depression have been researched in high-income countries. A recent systematic review found that only three articles reported results of RCTs on internet-delivered interventions for mental health conditions in LMICs .
SilverCloud platform evidence: Space from depression
Space from Depression (Yo puedo sentirme bien – Spanish version) is a seven module CBT-based intervention for the treatment of depression. Recently, Richards, Timulak  reported that Space from Depression programme showed lower levels of depression symptoms post-treatment, compared to their baseline score, yielding a large post-treatment effect (d = 0.91). They reported significant differences between the treatment group and waiting list control group (d = 0.50). The positive outcomes were maintained at three and six months’ follow-up. The treatment was evaluated by users as acceptable and satisfactory .
Culturally adapted psychotherapy (CAP)
Although low-intensity interventions for depression have been developed in western high-income countries and these interventions therefore have been influenced by their specific cultural context (for example, Ireland, UK, Australia), it is important to consider how cultural context may impact on the adaptation for use in LMICs such as Colombia. The authors argue that cultural aspects need to be taken into consideration when translating and adapting interventions to help guarantee similar results to those that have been achieved in high-income countries.
Culturally adapted psychotherapy (CAP) is defined as a systematic change of intervention protocols through consideration of relevance to the culture of the target population and modifies treatment in accordance with clients’ contexts and values . According to Resnicow, Soler  cultural sensitivity has two dimensions, top-down adaptations (e.g., language) and bottom-up adaptations (e.g., cultural, social, historical, environmental and psychological aspects), which indicate varying degrees of integration of culture in psychotherapy. Additionally, ecological validity refers to a process that allows generalisation of assumptions derived from research situations to other environments and considers dimensions such as language, persons, metaphors, concepts, contexts, methods, and goals . Further, principles from cross-cultural assessment research (i.e., functional equivalence, conceptual equivalence, linguistic equivalence) contribute to assessing the cultural adaptation of the programme .
Outcomes from CAP research
Meta-analyses have analysed the efficacy of CAP in comparison to non-adapted interventions and other control groups such as waiting list groups in adults. A recent meta-analysis found 136 published studies from previous meta-analysis. The meta-analysis found the overall affect size was d = 0.67, which indicates that culturally adapted interventions have better outcomes than other conditions (non-adapted treatment or control group). Likewise treatment effect sizes were significantly larger (d = 0.76) in treatment studies than in prevention studies (0.25) .
An older meta-analysis by Griner and Smith  reported the outcomes from 76 studies of service providers that were classified according to ethnic and/or socio-racial status. The results showed a weighted average effect size of (d = 0.45), indicating a moderately strong benefit for the culturally adapted interventions in comparison to control group.
Culturally adapted internet-delivered treatment
Some studies have considered cultural adaptation for low-intensity internet-delivered treatments. An open trial study  examined the preliminary efficacy and acceptability of a culturally modified therapist-guided CBT treatment for anxiety and depression. The results showed that participants improved significantly across all outcome measures, with large within-group effect sizes (Cohen’s d) at post-treatment (d = 1.08 to 1.74) and 3-month follow-up (d = 1.53 to 2.00). Another study  showed the efficacy of a cognitive behavioural internet-delivered treatment for depression with weekly telephone support. Treatment group participants reported significantly reduced depressive symptoms (Cohen’s d = 0.93) up to 3-months after treatment compared to a control group. Furthermore, Ince, Cuijpers  in a randomised control trial demonstrated reductions in depression symptoms in participants using the internet-based, self-help problem-solving intervention, yielding a moderate effect size (Cohen’s d = 0.50). Finally, Wagner, Schulz  evaluated an internet-based CBT with therapist support for people with posttraumatic stress disorder (PTSD), which showed significant decreases in symptoms of PTSD (d = 1.57), depression (d = 1.51), and anxiety (d = 1.50) and increases in quality of life (d = 1.17) post-treatment.
A recent review and meta-analysis on cultural adaptation of minimally guided interventions for common mental disorders, which included e-mental health delivered interventions and bibliotherapy, found that insufficient details on the methodologies used for cultural adaptation were reported. However, these studies showed an increase in effect size of 0.117 (P = .04), or a 14% rise in pooled efficacy . Despite the outcomes showing positive post-treatment results, more research is required to develop interventions that incorporate systematic CAP frameworks, especially as the processes for culturally adapting interventions have not been systematic and clearly or fully described in previous research. The current study seeks to examine the acceptability and efficacy of a culturally adapted cognitive behavioural internet-delivered intervention in Colombia - South America.
Aims and hypothesis
We aim to assess the efficacy of a culturally adapted cognitive behavioural internet-delivered treatment for college students with depressive symptoms in Colombia. In line with other studies in high-income countries (HICs), and using an already established intervention, we hypothesise that the culturally adapted Space from Depression programme will be efficacious, with significant changes within the treatment group and differences post-treatment between the active treatment and the waiting list control group.
The study is a mixed method approach utilising in study 1 quantitative and qualitative methods to assist in the cultural adaptation of the Space from Depression intervention and in study 2 a randomised control design to examine the efficacy of the culturally-adapted intervention.
The programme Space from Depression will be culturally adapted for a Colombian population using cultural sensitivity and ecological validity frameworks, including principles from cross-cultural assessment research (Study 1). Once the programme is culturally adapted, it will be tested using a randomised controlled trial methodology (Study 2).
Study 1: Cultural adaptation (cultural sensitivity and ecological validity)
The process for cultural sensitivity will be developed using a “top-down” methodology as described in the framework by Resnicow, Soler . This process will be carried out by the principal researcher (AS) in conjunction with collaborators from SilverCloud Health (the developers), and professional translators and video production teams from Colombia. The process will involve a revision of the translated content in all sections and the inclusion of Colombian expressions for instance, “guayabo” (hung over), “ciclovía” (bike roads on Sundays) among others. Furthermore, videos and personal stories will be revised to include typical situations and stereotypes for Colombian students, such as Colombian actors and Latin American college stories (e.g. economic problems, pregnancy, relationships).
The process for ecological validity will be developed using approaches proposed by Bernal and Sáez-Santiago  and Helms  and will involve an evaluation of the programme by Colombian users and clinical experts. Through the use of a robust and theoretically-based methodology, the goal is to arrive at an acceptable and culturally adapted intervention that can then be used in a trial to examine its efficacy.
Five student users from a university in Colombia will evaluate the programme. Five experts in clinical psychology from Colombia and two clinical psychology experts from Argentina and Spain, who have experience with internet-delivered interventions and with translation and adaptation of interventions for use in Latin America, will evaluate the programme using the Cultural Relevance Questionnaire (CRQ) that was developed for this study.
Students will be selected on the following criteria: a) clinical psychology masters and PhD students at a Colombian University. Experts will be selected on the following criteria: a) native Spanish speaker from Colombia and other Spanish speaking countries; b) PhD in clinical psychology or in psychology; and c) experience in: CBT, depression, research, and low-intensity internet-delivered treatment. These criteria guarantee the rigorousness of the culturally adapted programme.
Recruitment and procedure
An email will be sent to masters and PhD psychology students with information about the research study, its aims and a description of the task. Thereafter, they will attend an information session with the researcher (AS) to further explain the study and to collect the informed consent documents from the participants. Participants will then review the programme and complete the CRQ after engaging with all of the treatment modules.
An invitation email will be sent to the seven identified expert researcher/ clinical psychologists in Bogota, Argentina and Spain. They will receive the study information, aims of the research and why it is important, and an invitation to evaluate the Space from Depression (Yo puedo sentirme bien) programme using the Cultural Relevance Questionnaire. Once they have signed the informed consent document and returned it by email to the research team, they will receive access to the platform and review the programme.
Study 2: Efficacy trial
The implementation of the culturally adapted programme and its evaluation among students using a randomised controlled trial methodology at two sites in Colombia.
Power analysis, carried out in G-Power using significance level α = 0.05 and power = 0.80 determined 45 subjects would be required for each test condition (active group and waiting list) to observe a moderate effect (d = 0.50) post-treatment between groups .
College students from two universities in Colombia will be included in this study. Both undergraduate and graduate level students from any school at a university in Bogota, and students of psychology, medicine, nursing and education from a university in Bucaramanga will be eligible to participate and will be selected according to the criteria described in Table 1, which mirrors the criteria used in other studies of this type , especially initial investigations in new territories.
An email will be sent to college students at two universities. Potential participants will be able to visit a website to receive information about the study, participation criteria, information about the treatment and how to get in contact to proceed with the study.
Once participants have read the study information, informed consent will be obtained from each user before screening and randomisation. Through the SilverCloud platform, participants will be instructed to type their name on the informed consent page, to indicate that they have read and understood the study information and agree to participate in the study. Thereafter, participants will complete measures for screening purposes, including the Patient Health Questionnaire (PHQ-9), Sociodemographic & Clinical History Questionnaire and Generalised Anxiety Disorder-7 (GAD-7). Thereafter, participants will be randomised based on their measures’ score through computer algorithms and they will be assigned to two groups – the active treatment group and waiting-list (WL) control group.
Those assigned to the active treatment will start the internet-delivered treatment immediately for seven weeks, while the WL participants’ treatment will start once the first group has finished the programme. Individuals not meeting the inclusion criteria at baseline assessment will be referred to other appropriate sources of face-to-face support at the student counselling service in the respective universities.
Any interactions or activities completed by the participants on the programme will be considered as a session, and it will be taken in the weekly feedback provided by the supporter. At the beginning of each session the participants will be asked to reflect on their previous session and complete the Helpful Aspects of Treatment Form (HAT). Furthermore, after week 7 the participants will complete Satisfaction with the Treatment (SAT).
Those who do not complete the research measures will receive automatic emails from the platform, to encourage them to use the programme. Likewise, supporters will send an email to the participants who do not complete the programme, and the research team will phone the participants who do not complete the measures.
After baseline screening, participants will be randomised and informed immediately about their group assignment. Randomisation will be handled by a computer algorithm administered by a person independent of the researchers. Figure 1 shows the CONSORT participant flow through the trial.
Intervention space from depression
Space from Depression programme (Yo puedo sentirme Bien –Spanish version) consists of seven modules of cognitive-behavioural therapy (Table 2). The treatment includes self-monitoring, behavioural activation, cognitive restructuring, and challenging core beliefs. All modules have the same structure and format, which consist of quizzes, videos, educational content, activities with homework suggestions and a module review page. Also, users have a supporter, who will give feedback asynchronously .
Wait list control group
Participants in the WL control group will receive treatment after seven weeks; therefore, this group will receive no treatment for the duration of the first seven weeks.
Participants will be assigned a supporter, who will be a postgraduate student in clinical psychology with supervised experience in CBT with adults. Supporters will be trained in the Space from Depression (Yo puedo sentirme bien) platform and programme before starting their role as a supporter and will be supervised by an experienced clinical psychologist at the university. Each supporter will be assigned users and they will provide asynchronous post-session feedback of between 10 and 15 min per participant per session. The role of the supporter consists of motivating and providing feedback to the users. They can schedule the feedback at specific times once each week for a period of seven weeks.
In study 1 cultural sensitivity will be determined through the ‘top-down’ revisions performed by the clinician researcher (AS), together with translation and customisation. Ecological validity using experts and users will assess the cultural relevance of the Space from Depression (Yo puedo sentirme bien) programme using the Cultural Relevance Questionnaire (CRQ).
In study 2, the efficacy trial, participants will be assessed at baseline, post treatment, and at 3-month follow-up. Details of the measures are described in Table 3.
Participants will be assessed at baseline through the Patient Health Questionnaire (PHQ-9), Sociodemographic & Clinical History Questionnaire and Generalised Anxiety Disorder-7 (GAD-7). At the beginning of each session participants will be asked to reflect on their previous session and complete the Helpful Aspects of Treatment Form (HAT). PHQ-9 and GAD-7 will be completed at week 7 and at follow-up (week 20 / 3 months). In addition, satisfaction with Treatment (SAT) will be administered at week 7.
Cultural Relevance Questionnaire (CRQ): The Cultural Relevance Questionnaire is an instrument that evaluates a culturally adapted psychotherapy protocol. This questionnaire is based on cultural sensitivity and ecological validity theory by Bernal (2009) and Helms (2015) and their proposals for culturally adapted evidence-based practices. The CRQ has two sections, which includes a general assessment of the programme and an assessment of each module. Based on the Helms (2015) categories of functional equivalence, conceptual equivalence and linguistic equivalence, the first section evaluates eight areas [(a) language, (b) persons, (c) metaphors (d) content, (e) concepts, (f) goals, (g) methods and (g) context]  and is composed of five questions assessed on a 5-point Likert scale. The second section evaluates each modules content, examples, and personal stories, collecting qualitative observations based on the categories: functional equivalence, conceptual equivalence and linguistic equivalence.
Sociodemographic Information & Clinical History Questionnaire: This instrument was developed based on a previous version  and it collects details on the participants, such as data on the length of time that one is experiencing depression symptoms. Also, it collects data on participants’ experience of counselling/therapy and medication for depression. Data is collected on whether one has a previous diagnosis of an organic mental health disorder such as schizophrenia, psychosis and bipolar disorder. In addition, it contains items related to co-morbidity of depression with alcohol and drug misuse, and/or any recent medical diagnosis.
Primary outcome measure
Patient Health Questionnaire (PHQ-9) : PHQ-9 is a 9-item self-report measure that assesses the nine depression symptoms from the DSM-IV depression criteria. Each item is scored on a 4-point scale (0–3) and scores range from 0 to 27. The score can be used to describe the patient’s symptoms in one of five categories: none (0–4), mild (5–9), moderate (10–14), moderately severe (15–19), and severe (20–27). The PHQ-9 has been shown to have good reliability and validity in primary care populations, and to have good internal consistency and structural validity (α = 0.89, α = 0.86, respectively) . PHQ-9 has been translated into Spanish and a Colombian version will be used in the current study (base on www.phqscreeeners.com/). The Spanish version of PHQ-9 has demonstrated reliability (α = 0.85) among Latinos in the U.S. [58, 59].
Secondary outcome measure
General Anxiety Disorder (GAD-7) : Comprises seven items measuring symptoms and severity of anxiety based on the DSM-IV diagnostic criteria. GAD-7 has shown reliability (α = 0.92) . The GAD-7 has been culturally adapted into Spanish  and is available in a Spanish language Colombian version (www.phqscreeeners.com/).
Helpful Aspects of Therapy Form (HAT) [63, 64]. It is an instrument that assesses the most helpful and hindering events in the therapy. Participants are asked to describe any event or anything they engaged with in the session that was helpful or hindering for them.
Satisfaction with Treatment (SAT) . At post-treatment, participants will be asked to complete a satisfaction with treatment measure. SAT asks clients about positive and negative experiences with the internet-delivered treatment. SAT contains two questions asking participants to describe what participants most liked and least liked about the online treatment.
The research project and all related materials were submitted and approved by the appropriate university ethics committees in Bogota (letter reference no. 552 on December 1st 2015) and Bucaramanga (letter reference no. 075 on March 28th 2016).
Study 1: Cultural adaptation (cultural sensitivity and ecological validity)
Descriptive statistics will report on the results from the quantitative questions on CRQ. The CRQ data collected from the five open questions and the open questions per module will be analysed qualitatively . The feedback will be categorised based on Helms  functional, conceptual and linguistic equivalence. The information will be assigned a colour code indicating positive and negative comments and suggestions for improving the programme. Likewise, new categories that might arise from the data will be considered. Finally, the results gathered from experts and users will be incorporated into the Space from Depression programme.
Study 2: Efficacy trial
All analyses will be based on the intention-to-treat principle. Participants’ data will be included irrespective of treatment compliance. All of the data will be prepared and reviewed in SPSS.
Descriptive statistics will be used to analyse sociodemographic variables (e.g., gender and age). Chi-squared and t-tests will be used to examine demographic differences and clinical characteristics in the groups .
Effects will be tested at the 0.05 level. To assess significant changes over time, repeated measures ANOVAs will be performed for the primary outcome measure for depression (PHQ-9) and secondary outcome (GAD-7) . The magnitude of effects within and between the two groups will be established by Cohen’s d statistic . This will determine what is considered a small effect (d ≥ 0.2), a medium effect (d ≥ 0.5) and a large effect (d ≥ 0.8) .
Analyses will be carried out with participants who have clinically significant changes at the end of the intervention and at follow-up. The assessments will be made using pre-treatment scores, and these will be compared to post-treatment scores and follow-up scores on the outcome measures PHQ-9 and GAD-7. The analysis will be based on the Jacobson & Truax method, where a reliable change equals the difference pre-test and post-test, divided by the standard error of the difference .
Linear Mixed Model will be used for repeated measures (PHQ-9, GAD7) on each participant over time; it allows for a variety of correlation patterns (variance and covariance structures) to be explicitly modelled . Also, it allows the measures on each subject to be used while accounting for missing data.
Participants’ responses in the HAT, identifying helpful and non-helpful events in the therapy and their impacts will be analysed qualitatively . At the beginning, individual units of text will be analysed and identified out of their context. Next, these meaning units will be organised into helpful and non-helpful events and their impacts. Finally, these will be grouped into categories, which will be suitably named and defined.
Descriptive analysis will be used to analyse quantitative data from the SAT and their qualitative responses analysed using thematic analysis.
This study aims to develop a robust and theoretically-informed methodology to adapt an internet-delivered intervention for depression in another culture. Research about cultural adaptation in psychotherapy is a relatively new field in psychology , and even more limited regarding the cultural adaptation of internet-delivered treatments . The cultural relevance of the programme will be assessed through CRQ, a theoretically based measure developed for the current study, which will be completed by users and experts. The CRQ focuses on the cultural sensitivity and ecological validity of interventions protocols. This measure and methodology is one of the first research contributions about culturally adapted internet-delivered psychotherapy, which will enable knowledge development for future studies with diverse populations in other countries in South America and further field. The methodology can be further refined and elaborated upon in future studies. The inclusion of diverse populations in clinical research has been a challenge for many years. Those are generally underrepresented in scientific and clinical analyses and are known to be a hard-to-reach population for research purposes . The current study supports this area and the relevant necessity to use culturally adapted internet-delivered interventions for depression.
The study further aims to evaluate the efficacy of the culturally adapted Space from Depression programme for college students with depressive symptoms in Colombia. The study will be a first contribution in South America regarding the potential impact of a culturally adapted internet-delivered, low-intensity intervention on depressive symptoms for college students as compared to a WL control group. Internet-delivered interventions could be a potential option for delivering evidence-based psychological intervention, and may overcome some of the significant barriers to accessing mental health treatment in Colombia.
Space from Depression has been investigated with college students and a community population, with significant improvements in depression pre-to-post treatment . We hypothesise that we can achieve similar positive outcomes from a culturally adapted version. Most of the studies of internet-delivered interventions have been studied in HICs, which might not generalizable to other populations worldwide. Culturally adapted internet-delivered interventions are an opportunity to access and disseminate evidence-base treatments. This type of treatment as an alternative for people who cannot access mental health services due to limited health insurance, or personal stigma  and therefore is relevant for Colombia.
A noted limitation is that the study will not include an official depression diagnosis of participants; however, it includes well-established measures of symptom severity that can allow us to establish the efficacy of low intensity internet-delivered treatments for depression among college students in Colombia.
Recruitment began in August 2016. Currently, the study is in progress.
Culturally adapted psychotherapy
Cognitive behaviour therapy
Cultural relevance questionnaire
Diagnostic statistical manual, 4th edition
General anxiety disorder, 7-item
Helpful aspects of therapy form
Internet-delivered cognitive behavioural therapy
Low and middle income countries
Patient health questionnaire, 9-item
Posttraumatic stress disorder
Randomised controlled trial
Satisfaction with treatment
Kessler R, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO world mental health (WMH) surveys. Epidemiologia e psichiatria sociale. 2009;18(01):23–33.
Bromet E, Andrade L, Hwang I, Sampson N, Alonso J, de Girolamo G, et al. Cross-national epidemiology of DSM-IV major depressive episode. BMC Med. 2011;9(1):90.
Kessler R, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27.
Ayuso-Mateos JL, Vázquez-Barquero JL, Dowrick C, Lehtinen V, Dalgard OS, Casey P, et al. Depressive disorders in Europe: prevalence figures from the ODIN study. Br J Psychiatry. 2001;179(4):308–16.
Gómez-Restrepo C, Bohórquez A, Pinto D, Gil J, Rondón M, Díaz-Granados N, et al. Prevalencia de depresión y factores asociados con ella en la población colombiana. Rev Panam Salud Pública. 2004;16(6):378–86.
Kohn R, Levav I. Caldas de Almeida JM, Vicente B, Andrade L, Caraveo-Anduaga JJ, et al. Los trastornos mentales en América Latina y el Caribe: asunto prioritario para la salud pública. Rev Panam Salud Publica. 2005;18(4/5):229–40.
Demyttenaere K, Bruffaerts R, Posada-Villa J, Gasquet I, Kovess V, Lepine J, et al. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization world mental health surveys. JAMA. 2004;291(21):2581–90.
Posada-Villa JA, Aguilar-Gaxiola SA, Magaña CG, Gómez LC. Prevalencia de trastornos mentales y uso de servicios: resultados preliminares del Estudio nacional de salud mental. Colombia, 2003. Revista Colombiana de psiquiatría. 2004;33(3):241–62.
Ministry of Health. National Mental Health survey. Bogota: Ministry of Health; 2015. Report No.: 978-958-8903-19-4.
Rodriguez J. La atención de Salud Mental en América Latina y el caribe. Rev Psiquiatr Urug. 2007;71(2):117–24.
Kalibatseva Z, Leong FTL. A critical review of culturally sensitive treatments for depression: recommendations for intervention and research. Psychol Serv. 2014;11(4):433–50.
Vally Z, Maggott C. Evaluating the outcome of cultural adaptations of cognitive-Behavioural therapy for adult depression: a meta-analysis of treatment studies in developing countries. Int J Adv Couns. 2015;37(4):293–304.
Arjadi R, Nauta M, Chowdhary N, Bockting C. A systematic review of online interventions for mental health in low and middle income countries: a neglected field. Global Mental Health. 2015;2:e12.
Ministry of Communications and Information Technology. Boletín Trimestral de las TICS - cifras primer semestre de 2015. Bogotá: Colombia Ministry of Communications and Information Technology; 2015.
Cuijpers P, Cristea IA, Ebert DD, Koot HM, Auerbach RP, Bruffaerts R, et al. Psychological treatment of depression in college students: a metaanalysis. Depression and anxiety. 2016;33(5):400–14.
Ibrahim AK, Kelly SJ, Adams CE, Glazebrook C. A systematic review of studies of depression prevalence in university students. J Psychiatr Res. 2013;47(3):391–400.
Cova Solar F, Alvial SW, Aro DM, Bonifetti DA, Hernández MM, Rodríguez CC. Problemas de salud mental en estudiantes de la Universidad de Concepción. = mental health problems in students from the university of Concepción. Terapia Psicológica. 2007;25(2):105–12.
Melo-Carrillo A, Van Oudenhove L, Lopez-Avila A. Depressive symptoms among Mexican medical students: high prevalence and the effect of a group psychoeducation intervention. J Affect Disord. 2012;136(3):1098–103.
Morales CF, Pérez VB, León SO, Medrano AJ, Urrutia Aguilar ME, Guevara-Guzmán R. Síntomas depresivos y rendimiento escolar en estudiantes de Medicina. = Depressive symptoms and academic performance in medical students. Salud Mental. 2013;36(1):59–65.
Nogueira-Martins LA, Neto RF, Macedo PCM, Cítero VA, Mari JJ. The mental health of graduate students at the Federal University of São Paulo: a preliminary report. Braz J Med Biol Res. 2004;37(10):1519–24.
Arrivillaga-Quintero M, Cortés-Garcia C, Goicochea-Jiménez VL, Lozano-Ortiz TM. Caracterización de la Depresión en Jóvenes Universitarios. Characterization of depression in university young people. Universitas Psychologica. 2004;3(1):17–26.
Richards D, Salamanca A. Point-prevalence of depression and associated risk factors. The Journal of Psychology: Interdisciplinary and Applied. 2014;148(3):305–26.
Beiter R, Nash R, McCrady M, Rhoades D, Linscomb M, Clarahan M, et al. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. J Affect Disord. 2015;173:90–6.
Cuijpers P, Cristea IA, Ebert DD, Koot HM, Auerbach RP, Bruffaerts R, Kessler RC. Psychological treatment of depression in college students: A meta-analysis. Depression and anxiety. 2016;33(5):400-14.
Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, et al. Mental disorders among college students in the World Health Organization world mental health surveys. Psychol Med. 2016;46(14):2955–70.
Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol. 2008;76(6):909–22.
Cuijpers P, Sijbrandij M, Koole SL, Andersson G, Beekman AT, Reynolds CF. The efficacy of psychotherapy and pharmacotherapy in treating depressive and anxiety disorders: a meta-analysis of direct comparisons. World Psychiatry. 2013;12(2):137–48.
Boumparis N, Karyotaki E, Kleiboer A, Hofmann SG, Cuijpers P. The effect of psychotherapeutic interventions on positive and negative affect in depression: a systematic review and meta-analysis. J Affect Disord. 2016;202:153–62.
Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitivebehavioural therapy for adult depression, alone and in comparison with other treatments. The Canadian Journal of Psychiatry / La Revue canadienne de psychiatrie. 2013;58(7):376–85.
National Institute for Health and Clinical Excellence. Depression in adults: recognition and management. England, UK: NICE; 2009. 2009. Contract No.: CG90.
Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Review of Pharmacoeconomics and Outcomes Research. 2012;12(6):745–64.
Spek V, Nyklíček I, Smits N, Cuijpers P, Riper H, Keyzer J, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med. 2007;37(12):1797–806.
Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internetbased mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. 2015;176:9–17.
Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42.
Ebert D, Tarnowski T, Gollwitzer M, Sieland B, Berking MA. Transdiagnostic internet-based maintenance treatment enhances the stability of outcome after inpatient cognitive behavioral therapy: a randomized controlled trial. Psychother Psychosom. 2013;82(4):246–56.
Andersson A, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13(3):288–95.
López-del-Hoyo Y, Olivan B, Luciano JV, Mayoral F, Roca M, Gili M, et al. Low intensity vs. self-guided internet-delivered psychotherapy for major depression: a multicenter, controlled, randomized study. BMC psychiatry. 2013;13(1):21.
Montero-Marín J, Araya R, Pérez-Yus MC, Mayoral F, Gili M, Botella C, Baños R, Castro A, Romero- Sanchez P, López-Del-Hoyo Y, Nogueira-Arjona R. An internet-based intervention for depression in primary Care in Spain: a randomized controlled trial. Journal of medical Internet research. 2016;18(8):e231.
Lara M, Tiburcio M, Aguilar-Abrego A, Sánchez-Solís A. A four-year experience with a web-based self-help intervention for depressive symptoms in Mexico. Rev Panam Salud Publica. 2014;35(5–6):399–406.
Espinosa HD, Carrasco Á, Moessner M, Cáceres C, Gloger S, Rojas G, Perez JC, Vanegas J, Bauer S, Krause M. Acceptability study of “Ascenso”: an online program for monitoring and supporting patients with depression in Chile. Telemedicine and e-Health. 2016;22(7):577-83.
Richards D, Timulak L, O’Brien E, Hayes C, Vigano N, Sharry J, et al. A randomized controlled trial of an internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression. Behav Res Ther. 2015;75:20–31.
Richards D, Murphy T, Viganó N, Timulak L, Doherty G, Sharry J, et al. Acceptability, satisfaction and perceived efficacy of “space from depression” an internet-delivered treatment for depression. Internet Interventions. 2016;5:12–22.
Bernal G, Jiménez-Chafey MI, Domenech Rodríguez MM. Cultural adaptation of treatments: a resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice. 2009;40(4):361–8.
Resnicow K, Soler R, Braithwaite RL, Ahluwalia JS, Butler J. Cultural sensitivity in substance use prevention. Journal of community psychology. 2000;28(3):271–90.
Bernal G, Sáez-Santiago E. Culturally centered psychosocial interventions. Journal of Community Psychology. 2006;34(2):121.
Helms JE. An examination of the evidence in culturally adapted evidence-based or empirically supported interventions. Transcultural Psychiatry. 2015;52(2):174.
Hall GCN, Ibaraki AY, Huang ER, Marti CN, Stice E. A meta-analysis of cultural adaptations of psychological interventions. Behav Ther. 2016;47(6):993–1014.
Griner D, Smith TB. Culturally adapted mental health intervention: a meta-analytic review. Psychother Theory Res Pract Train. 2006;43(4):531–48.
Kayrouz R, Dear BF, Johnston L, Gandy M, Fogliati VJ, Sheehan J, et al. A feasibility open trial of guided internet-delivered cognitive behavioural therapy for anxiety and depression amongst Arab Australians. Internet Interventions - The application of information technology in mental and behavioural. 2015;2:32–8.
Choi I, Zou J, Titov N, Dear BF, Li S, Johnston L, et al. Culturally attuned internet treatment for depression amongst Chinese Australians: a randomised controlled trial. J Affect Disord. 2012;136(3):459–68.
Ince BÜ, Cuijpers P. Van 't Hof E, van Ballegooijen W, Christensen H, riper H. Internet-based, culturally sensitive, problem-solving therapy for Turkish migrants with depression: randomized controlled trial. J Med Internet Res. 2013;15(10):248–62.
Wagner B, Schulz W, Knaevelsrud C. Efficacy of an internet-based intervention for posttraumatic stress disorder in Iraq: a pilot study. Psychiatry Res. 2012;195(1–2):85–8.
Harper-Shehadeh M, Heim E, Chowdhary N, Maercker A, Albanese E. Cultural adaptation of minimally guided interventions for common mental disorders: a systematic review and meta-analysis. JMIR Ment Health. 2016;3(3):e44.
Guo Y, Logan HL, Glueck DH, Muller KE. Selecting a sample size for studies with repeated measures. BMC Med Res Methodol. 2013;13(1):1.
Richards D, Timulak L, Hevey D. A comparison of two online cognitive-behavioural interventions for symptoms of depression in a student population: the role of therapist responsiveness. Counselling & Psychotherapy Research. 2013;13(3):184–93.
Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–15.
Kroenke K, Spitzer RL, Williams JB. The phq-9. J Gen Intern Med. 2001;16(9):606–13.
Merz EL, Malcarne VL, Roesch SC, Riley N, Sadler GR. A multigroup confirmatory factor analysis of the patient health Questionnaire-9 among English- and Spanish-speaking Latinas. Cult Divers Ethn Minor Psychol. 2011;17(3):309–16.
Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the patient health questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602.
Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, et al. Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med Care. 2008;46(3):266–74.
Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.
García-Campayo J, Zamorano E, Ruiz MA, Pardo A, Pérez-Páramo M, López-Gómez V, Freire O, Rejas J. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health and Quality of Life Outcomes. 2010;8(1):8:1-11.
Llewelyn SP. Psychological therapy as viewed by clients and therapists. Br J Clin Psychol. 1988;27(3):223–37.
Elliott R, Slatick E, Urman M. Qualitative change process research on psychotherapy: alternative strategies. Psychological Test and Assessment Modeling. 2001;43(3):69.
Richards D, Timulak L. Satisfaction with therapist-delivered vs. self-administered online cognitive behavioural treatments for depression symptoms in college students. British Journal of Guidance & Counselling. 2013;41(2):193–207.
Dey I. Qualitative data analysis: a user friendly guide for social scientists: Routledge; 2003.
Field A. Discovering statistics using SPSS: sage publications; 2009.
Gueorguieva R, Krystal JH. Move over anova: progress in analyzing repeated-measures data andits reflection in papers published in the archives of general psychiatry. Arch Gen Psychiatry. 2004;61(3):310–7.
Cohen J. In: Hillsdale NJ, editor. Statistical power analysis for the behavioral sciences. 2nd edition. Hillsdale, NJ: Lawrence Earlbaum Associates; 1988.
Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12.
Verbeke G, Molenberghs G. Linear mixed models for longitudinal data: Springer Science & Business Media; 2009.
Richards D, Timulak L, Doherty G, Sharry J, Colla A, Joyce C, et al. Internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression: protocol for a randomized controlled trial. BMC Psychiatry. 2014;14:147.
Alicia Salamanca would like to acknowledge with thanks her scholarship award [EPSPG/2014/98] under the Enterprise/ Academia collaboration scheme.
Ethical approval and consent to participate
The research project and all related materials were submitted and approved by the appropriate university ethics committees:
Research Ethics Committee, Universidad de Los Andes, Bogotá, letter reference no. 552 on December 1st 2015.
Research Ethics Committee, Universidad Autonoma de Bucaramanga, Bucaramanga, letter reference no. 075 on March 28th 2016.
All individuals interested in participating in the research described in this study protocol will provide written informed consent through the SilverCloud Platform.
AS is the principal investigator for the project. AS, DR & LT conceptualised the initial trial design. The manuscript was written by AS, with significant contributions and revisions from DR, LT and LC. Both MM and YP contributed to the design of the study through their contribution as site specific investigators and they reviewed and contributed to the final version of this manuscript. AS distributed the manuscript to the group for discussion and revisions. The finalised manuscript was agreed by all authors.
The study is funded by the IRC and SilverCloud Health under the Enterprise/ Academia collaboration scheme. [EPSPG/2014/98].
Availability of data and materials
Consent for publication
Alicia Salamanca is the recipient of an Irish Research Council (IRC) scholarship award [EPSPG/2014/98] under the Enterprise/ Academia collaboration scheme. The scholarship is funded by the IRC and SilverCloud Health. Dr. Derek Richards is Director of Clinical Research at SilverCloud Health. Dr. Ladislav Timulak provides a research consultancy for SilverCloud Health.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Salamanca-Sanabria, A., Richards, D., Timulak, L. et al. Assessing the efficacy of a culturally adapted cognitive behavioural internet-delivered treatment for depression: protocol for a randomised controlled trial. BMC Psychiatry 18, 53 (2018). https://doi.org/10.1186/s12888-018-1634-x
- Culturally adapted psychotherapy
- Internet-delivered treatment
- Depressive symptoms
- College students
- Randomised trial