Skip to content


BMC Psychiatry

Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Assessing the efficacy of a culturally adapted cognitive behavioural internet-delivered treatment for depression: protocol for a randomised controlled trial

  • Alicia Salamanca-Sanabria1, 5Email author,
  • Derek Richards1, 2,
  • Ladislav Timulak1,
  • Leónidas Castro-Camacho3,
  • Mónica Mojica-Perilla4 and
  • Yamilena Parra-Villa4
BMC PsychiatryBMC series – open, inclusive and trusted201818:53

Received: 29 January 2018

Accepted: 14 February 2018

Published: 27 February 2018



Depression is the principal cause of disability in the world. High prevalence rates of depression in general populations and college students have been found worldwide and in various cultural groups. Low-intensity cognitive behavioural internet-delivered treatment has demonstrated efficacy in high-income-countries (HICs). However little is known of their potential for adaptation and efficacy in low and middle-income countries.


Study (1) involves the cultural adaptation of the Space from Depression cognitive-behaviour internet-delivered programme with an asynchronous support for depressive symptoms. This includes initial researcher/clinician adaptation and the integration of cultural assessment feedback of the programme by a panel of experts and users through the theoretically-based Cultural Relevance Questionnaire (CRQ). Study (2) describes the implementation of the culturally adapted intervention using a randomised controlled trial methodology. The efficacy trial will include an active treatment group and a waiting-list control group of participants meeting eligibility criteria (mild to moderate depression symptoms). The active condition will consist of 7 weekly modules of internet-delivered cognitive behavioural therapy (iCBT) Space from Depression, with post-session feedback support. The primary outcome will be the Patient Health Questionnaire (PHQ-9). The study also involves collection of client reported significant events and client satisfaction with the internet-delivered treatment. Data will be collected at baseline and at post-treatment (week 7), and at follow-up (week 20/3 months). Analysis will be conducted on the intention-to-treat basis.


The study seeks to establish a theoretically robust methodology for culturally adapting internet-delivered interventions for mental health disorders and to evaluate the efficacy of a culturally adapted internet-delivered treatment for depression in Colombia, with support. The study will be a first contribution to a method for culturally adapting internet-delivered interventions and also a first to examine the efficacy of such an adapted intervention in Latin America.

Trial registration

Clinical trials NCT03062215. Retrospectively registered 14th February 2017.


Culturally adapted psychotherapyInternet-delivered treatmentDepressive symptomsCBTCollege studentsRandomised trial


High rates of depression have been reported throughout the world [1, 2]. For instance, a 12-month prevalence rate has been estimated in the U.S. at 9.5% and in Europe at 8.5% of the population [3, 4]. In Colombia, 12-month prevalence is between 6.2% and 12.1% [58]. The Colombian National Mental Health Survey (2015) has estimated point prevalence of mild to moderate depressive symptoms at 15.6% and severe depressive symptoms at 4.2% of adults. About 50% of the population does not have access to health services [9], while the majority of the population with mental health problems do not have adequate insurance coverage [10].

Despite the necessity to implement psychological interventions in Latin America, there are few studies in this field [11]. More so, treatments are mostly pharmacological, and evidence-based psychological treatments are rarely used. Furthermore, treatments in low and middle income countries (LMICs) are implemented without considering cultural context: very little research has investigated culturally adapted treatments [12], while there is even less research about internet-delivered treatments [13]. Internet delivered psychological treatment may be a suitable alternative to make evidence-based treatments available, especially when nearly 54% of the population use the internet [14].

Depressive symptoms in college students

Depressive disorders have shown to be more frequent among college students in comparison with the general population [15]. For instance, a systematic review shows a weighted mean prevalence of depression symptoms in college students of 30.6% [16]. These rates are comparable to reports from Latin America [1720]. In Colombia one study reported high prevalence of depression symptoms (30%) in students [21]. Another recent study showed 36.2% prevalence of depression symptoms in a university sample [22].

Several variables have been associated with vulnerability of college students to depression: changes in lifestyle related to poor sleep habits, eating disorders, economic stressors and family problems [16, 23]. In spite of the high rates of depression within the college population, research studies and treatment for depression in Colombia have received little attention [24]. Recently, a World Mental Health survey reports that only 16.4% of students received treatment for their mental disorder, while in lower-middle/low income countries it was 6.7% [25].

Treating depression

Psychological treatments for depression have shown better outcomes in comparison with waiting list or placebo and combined treatment is more effective than pharmacotherapy alone [26, 27]. Boumparis, Karyotaki [28] found that psychological treatments can enhance positive affect and decrease negative affect in depression, contributing to better outcomes. A recent meta-analysis showed that Cognitive Behaviour Therapy (CBT) has been extensively researched and it has been demonstrated to be effective for depression [29].

Low intensity internet-delivered treatment

Low-intensity internet-delivered treatment involves self-guidance, where the content, including CBT techniques that are typically used in face-to-face therapy are delivered using text, pictures, animations, audio files and videos. This type of intervention is highly structured, it involves psychoeducation, activities and supplementary resources, such as a supporter contact via asynchronous message [30].

Internet-delivered interventions have an established empirical base for major depression [31], sub-threshold depression [32], and in maintenance treatments [3335]. For instance, a systematic review of computer-based interventions for depression found a mean effect size of d = 0.78 for the reduction of depressive symptoms post-treatment [34]. A recent review showed how face-to-face psychotherapy and internet-delivered therapy had similar effects [36].

Internet-interventions for depression are available in many languages. Research from Spanish language versions including López-del-Hoyo, Olivan [37] and Montero-Marín, Araya [38] reported positively on the effectiveness of a CBT-based internet-delivered programme for depression. A recent four-year descriptive, naturalistic study monitoring a web-based CBT treatment developed and researched in Mexico indicated that the intervention was useful for depressive symptoms [39]. A feasibility study in Chile found an online treatment to be beneficial, acceptable and feasible [40].

For the most part, internet interventions for depression have been researched in high-income countries. A recent systematic review found that only three articles reported results of RCTs on internet-delivered interventions for mental health conditions in LMICs [13].

SilverCloud platform evidence: Space from depression

Space from Depression (Yo puedo sentirme bien – Spanish version) is a seven module CBT-based intervention for the treatment of depression. Recently, Richards, Timulak [41] reported that Space from Depression programme showed lower levels of depression symptoms post-treatment, compared to their baseline score, yielding a large post-treatment effect (d = 0.91). They reported significant differences between the treatment group and waiting list control group (d = 0.50). The positive outcomes were maintained at three and six months’ follow-up. The treatment was evaluated by users as acceptable and satisfactory [42].

Culturally adapted psychotherapy (CAP)

Although low-intensity interventions for depression have been developed in western high-income countries and these interventions therefore have been influenced by their specific cultural context (for example, Ireland, UK, Australia), it is important to consider how cultural context may impact on the adaptation for use in LMICs such as Colombia. The authors argue that cultural aspects need to be taken into consideration when translating and adapting interventions to help guarantee similar results to those that have been achieved in high-income countries.

Culturally adapted psychotherapy (CAP) is defined as a systematic change of intervention protocols through consideration of relevance to the culture of the target population and modifies treatment in accordance with clients’ contexts and values [43]. According to Resnicow, Soler [44] cultural sensitivity has two dimensions, top-down adaptations (e.g., language) and bottom-up adaptations (e.g., cultural, social, historical, environmental and psychological aspects), which indicate varying degrees of integration of culture in psychotherapy. Additionally, ecological validity refers to a process that allows generalisation of assumptions derived from research situations to other environments and considers dimensions such as language, persons, metaphors, concepts, contexts, methods, and goals [45]. Further, principles from cross-cultural assessment research (i.e., functional equivalence, conceptual equivalence, linguistic equivalence) contribute to assessing the cultural adaptation of the programme [46].

Outcomes from CAP research

Meta-analyses have analysed the efficacy of CAP in comparison to non-adapted interventions and other control groups such as waiting list groups in adults. A recent meta-analysis found 136 published studies from previous meta-analysis. The meta-analysis found the overall affect size was d = 0.67, which indicates that culturally adapted interventions have better outcomes than other conditions (non-adapted treatment or control group). Likewise treatment effect sizes were significantly larger (d = 0.76) in treatment studies than in prevention studies (0.25) [47].

An older meta-analysis by Griner and Smith [48] reported the outcomes from 76 studies of service providers that were classified according to ethnic and/or socio-racial status. The results showed a weighted average effect size of (d = 0.45), indicating a moderately strong benefit for the culturally adapted interventions in comparison to control group.

Culturally adapted internet-delivered treatment

Some studies have considered cultural adaptation for low-intensity internet-delivered treatments. An open trial study [49] examined the preliminary efficacy and acceptability of a culturally modified therapist-guided CBT treatment for anxiety and depression. The results showed that participants improved significantly across all outcome measures, with large within-group effect sizes (Cohen’s d) at post-treatment (d = 1.08 to 1.74) and 3-month follow-up (d = 1.53 to 2.00). Another study [50] showed the efficacy of a cognitive behavioural internet-delivered treatment for depression with weekly telephone support. Treatment group participants reported significantly reduced depressive symptoms (Cohen’s d = 0.93) up to 3-months after treatment compared to a control group. Furthermore, Ince, Cuijpers [51] in a randomised control trial demonstrated reductions in depression symptoms in participants using the internet-based, self-help problem-solving intervention, yielding a moderate effect size (Cohen’s d = 0.50). Finally, Wagner, Schulz [52] evaluated an internet-based CBT with therapist support for people with posttraumatic stress disorder (PTSD), which showed significant decreases in symptoms of PTSD (d = 1.57), depression (d = 1.51), and anxiety (d = 1.50) and increases in quality of life (d = 1.17) post-treatment.

A recent review and meta-analysis on cultural adaptation of minimally guided interventions for common mental disorders, which included e-mental health delivered interventions and bibliotherapy, found that insufficient details on the methodologies used for cultural adaptation were reported. However, these studies showed an increase in effect size of 0.117 (P = .04), or a 14% rise in pooled efficacy [53]. Despite the outcomes showing positive post-treatment results, more research is required to develop interventions that incorporate systematic CAP frameworks, especially as the processes for culturally adapting interventions have not been systematic and clearly or fully described in previous research. The current study seeks to examine the acceptability and efficacy of a culturally adapted cognitive behavioural internet-delivered intervention in Colombia - South America.


Aims and hypothesis

We aim to assess the efficacy of a culturally adapted cognitive behavioural internet-delivered treatment for college students with depressive symptoms in Colombia. In line with other studies in high-income countries (HICs), and using an already established intervention, we hypothesise that the culturally adapted Space from Depression programme will be efficacious, with significant changes within the treatment group and differences post-treatment between the active treatment and the waiting list control group.


The study is a mixed method approach utilising in study 1 quantitative and qualitative methods to assist in the cultural adaptation of the Space from Depression intervention and in study 2 a randomised control design to examine the efficacy of the culturally-adapted intervention.


The programme Space from Depression will be culturally adapted for a Colombian population using cultural sensitivity and ecological validity frameworks, including principles from cross-cultural assessment research (Study 1). Once the programme is culturally adapted, it will be tested using a randomised controlled trial methodology (Study 2).

Study 1: Cultural adaptation (cultural sensitivity and ecological validity)

The process for cultural sensitivity will be developed using a “top-down” methodology as described in the framework by Resnicow, Soler [44]. This process will be carried out by the principal researcher (AS) in conjunction with collaborators from SilverCloud Health (the developers), and professional translators and video production teams from Colombia. The process will involve a revision of the translated content in all sections and the inclusion of Colombian expressions for instance, “guayabo” (hung over), “ciclovía” (bike roads on Sundays) among others. Furthermore, videos and personal stories will be revised to include typical situations and stereotypes for Colombian students, such as Colombian actors and Latin American college stories (e.g. economic problems, pregnancy, relationships).

The process for ecological validity will be developed using approaches proposed by Bernal and Sáez-Santiago [45] and Helms [46] and will involve an evaluation of the programme by Colombian users and clinical experts. Through the use of a robust and theoretically-based methodology, the goal is to arrive at an acceptable and culturally adapted intervention that can then be used in a trial to examine its efficacy.


Five student users from a university in Colombia will evaluate the programme. Five experts in clinical psychology from Colombia and two clinical psychology experts from Argentina and Spain, who have experience with internet-delivered interventions and with translation and adaptation of interventions for use in Latin America, will evaluate the programme using the Cultural Relevance Questionnaire (CRQ) that was developed for this study.

Eligibility criteria

Students will be selected on the following criteria: a) clinical psychology masters and PhD students at a Colombian University. Experts will be selected on the following criteria: a) native Spanish speaker from Colombia and other Spanish speaking countries; b) PhD in clinical psychology or in psychology; and c) experience in: CBT, depression, research, and low-intensity internet-delivered treatment. These criteria guarantee the rigorousness of the culturally adapted programme.

Recruitment and procedure

An email will be sent to masters and PhD psychology students with information about the research study, its aims and a description of the task. Thereafter, they will attend an information session with the researcher (AS) to further explain the study and to collect the informed consent documents from the participants. Participants will then review the programme and complete the CRQ after engaging with all of the treatment modules.

An invitation email will be sent to the seven identified expert researcher/ clinical psychologists in Bogota, Argentina and Spain. They will receive the study information, aims of the research and why it is important, and an invitation to evaluate the Space from Depression (Yo puedo sentirme bien) programme using the Cultural Relevance Questionnaire. Once they have signed the informed consent document and returned it by email to the research team, they will receive access to the platform and review the programme.

Study 2: Efficacy trial

The implementation of the culturally adapted programme and its evaluation among students using a randomised controlled trial methodology at two sites in Colombia.

Sample size

Power analysis, carried out in G-Power using significance level α = 0.05 and power = 0.80 determined 45 subjects would be required for each test condition (active group and waiting list) to observe a moderate effect (d = 0.50) post-treatment between groups [54].

Eligibility criteria

College students from two universities in Colombia will be included in this study. Both undergraduate and graduate level students from any school at a university in Bogota, and students of psychology, medicine, nursing and education from a university in Bucaramanga will be eligible to participate and will be selected according to the criteria described in Table 1, which mirrors the criteria used in other studies of this type [41], especially initial investigations in new territories.
Table 1

Eligibility criteria

Exclusion criteria:

 Severe depressive symptoms > 19 on PHQ-9

 Suicidal ideation or intent: Score of 2 or above on PHQ-9 question 9 Psychosis

 Currently in psychological treatment for depression

 On medication for less than 1 month

 Alcohol or drugs misuse

 Previous diagnosis of an organic mental health disorder

 Depression preceding or coinciding a diagnosed medical condition

Inclusion criteria

 18-year-old minimum

 Mild to moderately severe depressive symptoms: (PHQ-9 score 10–19)

User recruitment

An email will be sent to college students at two universities. Potential participants will be able to visit a website to receive information about the study, participation criteria, information about the treatment and how to get in contact to proceed with the study.


Once participants have read the study information, informed consent will be obtained from each user before screening and randomisation. Through the SilverCloud platform, participants will be instructed to type their name on the informed consent page, to indicate that they have read and understood the study information and agree to participate in the study. Thereafter, participants will complete measures for screening purposes, including the Patient Health Questionnaire (PHQ-9), Sociodemographic & Clinical History Questionnaire and Generalised Anxiety Disorder-7 (GAD-7). Thereafter, participants will be randomised based on their measures’ score through computer algorithms and they will be assigned to two groups – the active treatment group and waiting-list (WL) control group.

Those assigned to the active treatment will start the internet-delivered treatment immediately for seven weeks, while the WL participants’ treatment will start once the first group has finished the programme. Individuals not meeting the inclusion criteria at baseline assessment will be referred to other appropriate sources of face-to-face support at the student counselling service in the respective universities.

Any interactions or activities completed by the participants on the programme will be considered as a session, and it will be taken in the weekly feedback provided by the supporter. At the beginning of each session the participants will be asked to reflect on their previous session and complete the Helpful Aspects of Treatment Form (HAT). Furthermore, after week 7 the participants will complete Satisfaction with the Treatment (SAT).

Those who do not complete the research measures will receive automatic emails from the platform, to encourage them to use the programme. Likewise, supporters will send an email to the participants who do not complete the programme, and the research team will phone the participants who do not complete the measures.


After baseline screening, participants will be randomised and informed immediately about their group assignment. Randomisation will be handled by a computer algorithm administered by a person independent of the researchers. Figure 1 shows the CONSORT participant flow through the trial.
Fig. 1

Participant flow CONSORT

Intervention space from depression

Space from Depression programme (Yo puedo sentirme Bien –Spanish version) consists of seven modules of cognitive-behavioural therapy (Table 2). The treatment includes self-monitoring, behavioural activation, cognitive restructuring, and challenging core beliefs. All modules have the same structure and format, which consist of quizzes, videos, educational content, activities with homework suggestions and a module review page. Also, users have a supporter, who will give feedback asynchronously [41].
Table 2

Space from depression programme intervention description [41]


Brief description

Getting started

This module outlines the basic premise of CBT, provides information about depression, and introduces some of the key ideas of Space from Depression. Users are encouraged to begin to chart their own current difficulties with depression.

Tune in I: getting to grips with mood

The focus in this module is on mood monitoring and emotional literacy. Users can explore different aspects of emotions, physical reactions, action and inaction, and how they are related.

Tune in II: spotting thoughts

This module focuses on noting and tracking thoughts. Users can explore the connection between their cognitions and their mood and record them graphically.

Change It I: boosting behaviour

This module focuses on behavioural change as a way to improve mood. Ideas about behavioural activation are included, and users can plan and record activities and chart their relationship with their mood.

Change It II: challenge your thoughts

This module supports users to challenge distorted or overly negative thinking patterns with thought records, as well as helpful coping thoughts.

Change It III: core beliefs

This module outlines the role that deeply held core beliefs could play in mood and depression. Users can use a range of interactive activities to identify, challenge and balance any unhelpful core beliefs.

Bringing It all together

In this final module, users are encouraged to bring together all the skills and ideas they have gathered so far, note their personal warning signs, and make a plan for staying well.

Wait list control group

Participants in the WL control group will receive treatment after seven weeks; therefore, this group will receive no treatment for the duration of the first seven weeks.


Participants will be assigned a supporter, who will be a postgraduate student in clinical psychology with supervised experience in CBT with adults. Supporters will be trained in the Space from Depression (Yo puedo sentirme bien) platform and programme before starting their role as a supporter and will be supervised by an experienced clinical psychologist at the university. Each supporter will be assigned users and they will provide asynchronous post-session feedback of between 10 and 15 min per participant per session. The role of the supporter consists of motivating and providing feedback to the users. They can schedule the feedback at specific times once each week for a period of seven weeks.


In study 1 cultural sensitivity will be determined through the ‘top-down’ revisions performed by the clinician researcher (AS), together with translation and customisation. Ecological validity using experts and users will assess the cultural relevance of the Space from Depression (Yo puedo sentirme bien) programme using the Cultural Relevance Questionnaire (CRQ).

In study 2, the efficacy trial, participants will be assessed at baseline, post treatment, and at 3-month follow-up. Details of the measures are described in Table 3.
Table 3

Study measures to be used



Assessed variable

Time of assessment

Study 1 cultural validity

Cultural Relevance Questionnaire (CRQ)

Culturally adapted internet-delivered treatment

Completed by experts and users before the trial.

Study 2 efficacy trial

Patient Health Questionnaire (PHQ-9)

Depression symptoms

Baseline, post-treatment and follow- up

Generalised Anxiety Disorder 7 (GAD-7).

Anxiety symptoms

Baseline, post-treatment and follow- up

Sociodemographic & Clinical History Questionnaire

Gender, age, marital status, education, occupation, socioeconomic status and clinical history


Helpful and Hindering Aspects of Treatment (HAT)

Helpful and hindering aspects of treatment

After each session

Satisfaction with Treatment (SAT)

Satisfaction with therapy


Participants will be assessed at baseline through the Patient Health Questionnaire (PHQ-9), Sociodemographic & Clinical History Questionnaire and Generalised Anxiety Disorder-7 (GAD-7). At the beginning of each session participants will be asked to reflect on their previous session and complete the Helpful Aspects of Treatment Form (HAT). PHQ-9 and GAD-7 will be completed at week 7 and at follow-up (week 20 / 3 months). In addition, satisfaction with Treatment (SAT) will be administered at week 7.


Study 1

Cultural Relevance Questionnaire (CRQ): The Cultural Relevance Questionnaire is an instrument that evaluates a culturally adapted psychotherapy protocol. This questionnaire is based on cultural sensitivity and ecological validity theory by Bernal (2009) and Helms (2015) and their proposals for culturally adapted evidence-based practices. The CRQ has two sections, which includes a general assessment of the programme and an assessment of each module. Based on the Helms (2015) categories of functional equivalence, conceptual equivalence and linguistic equivalence, the first section evaluates eight areas [(a) language, (b) persons, (c) metaphors (d) content, (e) concepts, (f) goals, (g) methods and (g) context] [45] and is composed of five questions assessed on a 5-point Likert scale. The second section evaluates each modules content, examples, and personal stories, collecting qualitative observations based on the categories: functional equivalence, conceptual equivalence and linguistic equivalence.

Study 2

Screening measure

Sociodemographic Information & Clinical History Questionnaire: This instrument was developed based on a previous version [55] and it collects details on the participants, such as data on the length of time that one is experiencing depression symptoms. Also, it collects data on participants’ experience of counselling/therapy and medication for depression. Data is collected on whether one has a previous diagnosis of an organic mental health disorder such as schizophrenia, psychosis and bipolar disorder. In addition, it contains items related to co-morbidity of depression with alcohol and drug misuse, and/or any recent medical diagnosis.

Primary outcome measure

Patient Health Questionnaire (PHQ-9) [56]: PHQ-9 is a 9-item self-report measure that assesses the nine depression symptoms from the DSM-IV depression criteria. Each item is scored on a 4-point scale (0–3) and scores range from 0 to 27. The score can be used to describe the patient’s symptoms in one of five categories: none (0–4), mild (5–9), moderate (10–14), moderately severe (15–19), and severe (20–27). The PHQ-9 has been shown to have good reliability and validity in primary care populations, and to have good internal consistency and structural validity (α = 0.89, α = 0.86, respectively) [57]. PHQ-9 has been translated into Spanish and a Colombian version will be used in the current study (base on The Spanish version of PHQ-9 has demonstrated reliability (α = 0.85) among Latinos in the U.S. [58, 59].

Secondary outcome measure

General Anxiety Disorder (GAD-7) [60]: Comprises seven items measuring symptoms and severity of anxiety based on the DSM-IV diagnostic criteria. GAD-7 has shown reliability (α = 0.92) [61]. The GAD-7 has been culturally adapted into Spanish [62] and is available in a Spanish language Colombian version (

Others measures

Helpful Aspects of Therapy Form (HAT) [63, 64]. It is an instrument that assesses the most helpful and hindering events in the therapy. Participants are asked to describe any event or anything they engaged with in the session that was helpful or hindering for them.

Satisfaction with Treatment (SAT) [65]. At post-treatment, participants will be asked to complete a satisfaction with treatment measure. SAT asks clients about positive and negative experiences with the internet-delivered treatment. SAT contains two questions asking participants to describe what participants most liked and least liked about the online treatment.


The research project and all related materials were submitted and approved by the appropriate university ethics committees in Bogota (letter reference no. 552 on December 1st 2015) and Bucaramanga (letter reference no. 075 on March 28th 2016).

Planned analysis

Study 1: Cultural adaptation (cultural sensitivity and ecological validity)

Descriptive statistics will report on the results from the quantitative questions on CRQ. The CRQ data collected from the five open questions and the open questions per module will be analysed qualitatively [66]. The feedback will be categorised based on Helms [46] functional, conceptual and linguistic equivalence. The information will be assigned a colour code indicating positive and negative comments and suggestions for improving the programme. Likewise, new categories that might arise from the data will be considered. Finally, the results gathered from experts and users will be incorporated into the Space from Depression programme.

Study 2: Efficacy trial

All analyses will be based on the intention-to-treat principle. Participants’ data will be included irrespective of treatment compliance. All of the data will be prepared and reviewed in SPSS.

Descriptive statistics will be used to analyse sociodemographic variables (e.g., gender and age). Chi-squared and t-tests will be used to examine demographic differences and clinical characteristics in the groups [67].

Effects will be tested at the 0.05 level. To assess significant changes over time, repeated measures ANOVAs will be performed for the primary outcome measure for depression (PHQ-9) and secondary outcome (GAD-7) [68]. The magnitude of effects within and between the two groups will be established by Cohen’s d statistic [67]. This will determine what is considered a small effect (d ≥ 0.2), a medium effect (d ≥ 0.5) and a large effect (d ≥ 0.8) [69].

Analyses will be carried out with participants who have clinically significant changes at the end of the intervention and at follow-up. The assessments will be made using pre-treatment scores, and these will be compared to post-treatment scores and follow-up scores on the outcome measures PHQ-9 and GAD-7. The analysis will be based on the Jacobson & Truax method, where a reliable change equals the difference pre-test and post-test, divided by the standard error of the difference [70].

Linear Mixed Model will be used for repeated measures (PHQ-9, GAD7) on each participant over time; it allows for a variety of correlation patterns (variance and covariance structures) to be explicitly modelled [71]. Also, it allows the measures on each subject to be used while accounting for missing data.

Participants’ responses in the HAT, identifying helpful and non-helpful events in the therapy and their impacts will be analysed qualitatively [66]. At the beginning, individual units of text will be analysed and identified out of their context. Next, these meaning units will be organised into helpful and non-helpful events and their impacts. Finally, these will be grouped into categories, which will be suitably named and defined.

Descriptive analysis will be used to analyse quantitative data from the SAT and their qualitative responses analysed using thematic analysis.


This study aims to develop a robust and theoretically-informed methodology to adapt an internet-delivered intervention for depression in another culture. Research about cultural adaptation in psychotherapy is a relatively new field in psychology [46], and even more limited regarding the cultural adaptation of internet-delivered treatments [13]. The cultural relevance of the programme will be assessed through CRQ, a theoretically based measure developed for the current study, which will be completed by users and experts. The CRQ focuses on the cultural sensitivity and ecological validity of interventions protocols. This measure and methodology is one of the first research contributions about culturally adapted internet-delivered psychotherapy, which will enable knowledge development for future studies with diverse populations in other countries in South America and further field. The methodology can be further refined and elaborated upon in future studies. The inclusion of diverse populations in clinical research has been a challenge for many years. Those are generally underrepresented in scientific and clinical analyses and are known to be a hard-to-reach population for research purposes [13]. The current study supports this area and the relevant necessity to use culturally adapted internet-delivered interventions for depression.

The study further aims to evaluate the efficacy of the culturally adapted Space from Depression programme for college students with depressive symptoms in Colombia. The study will be a first contribution in South America regarding the potential impact of a culturally adapted internet-delivered, low-intensity intervention on depressive symptoms for college students as compared to a WL control group. Internet-delivered interventions could be a potential option for delivering evidence-based psychological intervention, and may overcome some of the significant barriers to accessing mental health treatment in Colombia.

Space from Depression has been investigated with college students and a community population, with significant improvements in depression pre-to-post treatment [41]. We hypothesise that we can achieve similar positive outcomes from a culturally adapted version. Most of the studies of internet-delivered interventions have been studied in HICs, which might not generalizable to other populations worldwide. Culturally adapted internet-delivered interventions are an opportunity to access and disseminate evidence-base treatments. This type of treatment as an alternative for people who cannot access mental health services due to limited health insurance, or personal stigma [72] and therefore is relevant for Colombia.

A noted limitation is that the study will not include an official depression diagnosis of participants; however, it includes well-established measures of symptom severity that can allow us to establish the efficacy of low intensity internet-delivered treatments for depression among college students in Colombia.

Trial status

Recruitment began in August 2016. Currently, the study is in progress.



Culturally adapted psychotherapy


Cognitive behaviour therapy


Cultural relevance questionnaire


Diagnostic statistical manual, 4th edition


General anxiety disorder, 7-item


Helpful aspects of therapy form


High-income countries


Internet-delivered cognitive behavioural therapy


Low and middle income countries


Patient health questionnaire, 9-item


Posttraumatic stress disorder


Randomised controlled trial


Satisfaction with treatment





Alicia Salamanca would like to acknowledge with thanks her scholarship award [EPSPG/2014/98] under the Enterprise/ Academia collaboration scheme.

Ethical approval and consent to participate

The research project and all related materials were submitted and approved by the appropriate university ethics committees:

Research Ethics Committee, Universidad de Los Andes, Bogotá, letter reference no. 552 on December 1st 2015.

Research Ethics Committee, Universidad Autonoma de Bucaramanga, Bucaramanga, letter reference no. 075 on March 28th 2016.

All individuals interested in participating in the research described in this study protocol will provide written informed consent through the SilverCloud Platform.

Authors’ contribution

AS is the principal investigator for the project. AS, DR & LT conceptualised the initial trial design. The manuscript was written by AS, with significant contributions and revisions from DR, LT and LC. Both MM and YP contributed to the design of the study through their contribution as site specific investigators and they reviewed and contributed to the final version of this manuscript. AS distributed the manuscript to the group for discussion and revisions. The finalised manuscript was agreed by all authors.


The study is funded by the IRC and SilverCloud Health under the Enterprise/ Academia collaboration scheme. [EPSPG/2014/98].

Availability of data and materials

Not applicable.

Consent for publication

Not applicable.

Competing interests

Alicia Salamanca is the recipient of an Irish Research Council (IRC) scholarship award [EPSPG/2014/98] under the Enterprise/ Academia collaboration scheme. The scholarship is funded by the IRC and SilverCloud Health. Dr. Derek Richards is Director of Clinical Research at SilverCloud Health. Dr. Ladislav Timulak provides a research consultancy for SilverCloud Health.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

E-mental Health Research Group, School of Psychology, Trinity College Dublin, Dublin, Ireland
Clinical Research and Innovation, SilverCloud Health, Dublin, Ireland
Universidad de los Andes, Bogotá, Colombia
Universidad Autónoma de Bucaramanga UNAB, Bucaramanga, Colombia
Aras an Phiarsaigh, School of Psychology, Trinity College Dublin, Dublin, Ireland


  1. Kessler R, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO world mental health (WMH) surveys. Epidemiologia e psichiatria sociale. 2009;18(01):23–33.View ArticlePubMedPubMed CentralGoogle Scholar
  2. Bromet E, Andrade L, Hwang I, Sampson N, Alonso J, de Girolamo G, et al. Cross-national epidemiology of DSM-IV major depressive episode. BMC Med. 2011;9(1):90.View ArticlePubMedPubMed CentralGoogle Scholar
  3. Kessler R, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617–27.View ArticlePubMedPubMed CentralGoogle Scholar
  4. Ayuso-Mateos JL, Vázquez-Barquero JL, Dowrick C, Lehtinen V, Dalgard OS, Casey P, et al. Depressive disorders in Europe: prevalence figures from the ODIN study. Br J Psychiatry. 2001;179(4):308–16.View ArticlePubMedGoogle Scholar
  5. Gómez-Restrepo C, Bohórquez A, Pinto D, Gil J, Rondón M, Díaz-Granados N, et al. Prevalencia de depresión y factores asociados con ella en la población colombiana. Rev Panam Salud Pública. 2004;16(6):378–86.View ArticlePubMedGoogle Scholar
  6. Kohn R, Levav I. Caldas de Almeida JM, Vicente B, Andrade L, Caraveo-Anduaga JJ, et al. Los trastornos mentales en América Latina y el Caribe: asunto prioritario para la salud pública. Rev Panam Salud Publica. 2005;18(4/5):229–40.View ArticlePubMedGoogle Scholar
  7. Demyttenaere K, Bruffaerts R, Posada-Villa J, Gasquet I, Kovess V, Lepine J, et al. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization world mental health surveys. JAMA. 2004;291(21):2581–90.View ArticlePubMedGoogle Scholar
  8. Posada-Villa JA, Aguilar-Gaxiola SA, Magaña CG, Gómez LC. Prevalencia de trastornos mentales y uso de servicios: resultados preliminares del Estudio nacional de salud mental. Colombia, 2003. Revista Colombiana de psiquiatría. 2004;33(3):241–62.Google Scholar
  9. Ministry of Health. National Mental Health survey. Bogota: Ministry of Health; 2015. Report No.: 978-958-8903-19-4.Google Scholar
  10. Rodriguez J. La atención de Salud Mental en América Latina y el caribe. Rev Psiquiatr Urug. 2007;71(2):117–24.Google Scholar
  11. Kalibatseva Z, Leong FTL. A critical review of culturally sensitive treatments for depression: recommendations for intervention and research. Psychol Serv. 2014;11(4):433–50.Google Scholar
  12. Vally Z, Maggott C. Evaluating the outcome of cultural adaptations of cognitive-Behavioural therapy for adult depression: a meta-analysis of treatment studies in developing countries. Int J Adv Couns. 2015;37(4):293–304.Google Scholar
  13. Arjadi R, Nauta M, Chowdhary N, Bockting C. A systematic review of online interventions for mental health in low and middle income countries: a neglected field. Global Mental Health. 2015;2:e12.Google Scholar
  14. Ministry of Communications and Information Technology. Boletín Trimestral de las TICS - cifras primer semestre de 2015. Bogotá: Colombia Ministry of Communications and Information Technology; 2015.Google Scholar
  15. Cuijpers P, Cristea IA, Ebert DD, Koot HM, Auerbach RP, Bruffaerts R, et al. Psychological treatment of depression in college students: a metaanalysis. Depression and anxiety. 2016;33(5):400–14.Google Scholar
  16. Ibrahim AK, Kelly SJ, Adams CE, Glazebrook C. A systematic review of studies of depression prevalence in university students. J Psychiatr Res. 2013;47(3):391–400.Google Scholar
  17. Cova Solar F, Alvial SW, Aro DM, Bonifetti DA, Hernández MM, Rodríguez CC. Problemas de salud mental en estudiantes de la Universidad de Concepción. = mental health problems in students from the university of Concepción. Terapia Psicológica. 2007;25(2):105–12.Google Scholar
  18. Melo-Carrillo A, Van Oudenhove L, Lopez-Avila A. Depressive symptoms among Mexican medical students: high prevalence and the effect of a group psychoeducation intervention. J Affect Disord. 2012;136(3):1098–103.Google Scholar
  19. Morales CF, Pérez VB, León SO, Medrano AJ, Urrutia Aguilar ME, Guevara-Guzmán R. Síntomas depresivos y rendimiento escolar en estudiantes de Medicina. = Depressive symptoms and academic performance in medical students. Salud Mental. 2013;36(1):59–65.Google Scholar
  20. Nogueira-Martins LA, Neto RF, Macedo PCM, Cítero VA, Mari JJ. The mental health of graduate students at the Federal University of São Paulo: a preliminary report. Braz J Med Biol Res. 2004;37(10):1519–24.Google Scholar
  21. Arrivillaga-Quintero M, Cortés-Garcia C, Goicochea-Jiménez VL, Lozano-Ortiz TM. Caracterización de la Depresión en Jóvenes Universitarios. Characterization of depression in university young people. Universitas Psychologica. 2004;3(1):17–26.Google Scholar
  22. Richards D, Salamanca A. Point-prevalence of depression and associated risk factors. The Journal of Psychology: Interdisciplinary and Applied. 2014;148(3):305–26.Google Scholar
  23. Beiter R, Nash R, McCrady M, Rhoades D, Linscomb M, Clarahan M, et al. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. J Affect Disord. 2015;173:90–6.Google Scholar
  24. Cuijpers P, Cristea IA, Ebert DD, Koot HM, Auerbach RP, Bruffaerts R, Kessler RC. Psychological treatment of depression in college students: A meta-analysis. Depression and anxiety. 2016;33(5):400-14.Google Scholar
  25. Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, et al. Mental disorders among college students in the World Health Organization world mental health surveys. Psychol Med. 2016;46(14):2955–70.Google Scholar
  26. Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol. 2008;76(6):909–22.Google Scholar
  27. Cuijpers P, Sijbrandij M, Koole SL, Andersson G, Beekman AT, Reynolds CF. The efficacy of psychotherapy and pharmacotherapy in treating depressive and anxiety disorders: a meta-analysis of direct comparisons. World Psychiatry. 2013;12(2):137–48.Google Scholar
  28. Boumparis N, Karyotaki E, Kleiboer A, Hofmann SG, Cuijpers P. The effect of psychotherapeutic interventions on positive and negative affect in depression: a systematic review and meta-analysis. J Affect Disord. 2016;202:153–62.Google Scholar
  29. Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitivebehavioural therapy for adult depression, alone and in comparison with other treatments. The Canadian Journal of Psychiatry / La Revue canadienne de psychiatrie. 2013;58(7):376–85.Google Scholar
  30. National Institute for Health and Clinical Excellence. Depression in adults: recognition and management. England, UK: NICE; 2009. 2009. Contract No.: CG90.Google Scholar
  31. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Review of Pharmacoeconomics and Outcomes Research. 2012;12(6):745–64.Google Scholar
  32. Spek V, Nyklíček I, Smits N, Cuijpers P, Riper H, Keyzer J, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med. 2007;37(12):1797–806.Google Scholar
  33. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internetbased mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. 2015;176:9–17.Google Scholar
  34. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42.Google Scholar
  35. Ebert D, Tarnowski T, Gollwitzer M, Sieland B, Berking MA. Transdiagnostic internet-based maintenance treatment enhances the stability of outcome after inpatient cognitive behavioral therapy: a randomized controlled trial. Psychother Psychosom. 2013;82(4):246–56.Google Scholar
  36. Andersson A, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13(3):288–95.Google Scholar
  37. López-del-Hoyo Y, Olivan B, Luciano JV, Mayoral F, Roca M, Gili M, et al. Low intensity vs. self-guided internet-delivered psychotherapy for major depression: a multicenter, controlled, randomized study. BMC psychiatry. 2013;13(1):21.Google Scholar
  38. Montero-Marín J, Araya R, Pérez-Yus MC, Mayoral F, Gili M, Botella C, Baños R, Castro A, Romero- Sanchez P, López-Del-Hoyo Y, Nogueira-Arjona R. An internet-based intervention for depression in primary Care in Spain: a randomized controlled trial. Journal of medical Internet research. 2016;18(8):e231.Google Scholar
  39. Lara M, Tiburcio M, Aguilar-Abrego A, Sánchez-Solís A. A four-year experience with a web-based self-help intervention for depressive symptoms in Mexico. Rev Panam Salud Publica. 2014;35(5–6):399–406.Google Scholar
  40. Espinosa HD, Carrasco Á, Moessner M, Cáceres C, Gloger S, Rojas G, Perez JC, Vanegas J, Bauer S, Krause M. Acceptability study of “Ascenso”: an online program for monitoring and supporting patients with depression in Chile. Telemedicine and e-Health. 2016;22(7):577-83.Google Scholar
  41. Richards D, Timulak L, O’Brien E, Hayes C, Vigano N, Sharry J, et al. A randomized controlled trial of an internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression. Behav Res Ther. 2015;75:20–31.Google Scholar
  42. Richards D, Murphy T, Viganó N, Timulak L, Doherty G, Sharry J, et al. Acceptability, satisfaction and perceived efficacy of “space from depression” an internet-delivered treatment for depression. Internet Interventions. 2016;5:12–22.Google Scholar
  43. Bernal G, Jiménez-Chafey MI, Domenech Rodríguez MM. Cultural adaptation of treatments: a resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice. 2009;40(4):361–8.Google Scholar
  44. Resnicow K, Soler R, Braithwaite RL, Ahluwalia JS, Butler J. Cultural sensitivity in substance use prevention. Journal of community psychology. 2000;28(3):271–90.Google Scholar
  45. Bernal G, Sáez-Santiago E. Culturally centered psychosocial interventions. Journal of Community Psychology. 2006;34(2):121.Google Scholar
  46. Helms JE. An examination of the evidence in culturally adapted evidence-based or empirically supported interventions. Transcultural Psychiatry. 2015;52(2):174.Google Scholar
  47. Hall GCN, Ibaraki AY, Huang ER, Marti CN, Stice E. A meta-analysis of cultural adaptations of psychological interventions. Behav Ther. 2016;47(6):993–1014.Google Scholar
  48. Griner D, Smith TB. Culturally adapted mental health intervention: a meta-analytic review. Psychother Theory Res Pract Train. 2006;43(4):531–48.Google Scholar
  49. Kayrouz R, Dear BF, Johnston L, Gandy M, Fogliati VJ, Sheehan J, et al. A feasibility open trial of guided internet-delivered cognitive behavioural therapy for anxiety and depression amongst Arab Australians. Internet Interventions - The application of information technology in mental and behavioural. 2015;2:32–8.Google Scholar
  50. Choi I, Zou J, Titov N, Dear BF, Li S, Johnston L, et al. Culturally attuned internet treatment for depression amongst Chinese Australians: a randomised controlled trial. J Affect Disord. 2012;136(3):459–68.Google Scholar
  51. Ince BÜ, Cuijpers P. Van 't Hof E, van Ballegooijen W, Christensen H, riper H. Internet-based, culturally sensitive, problem-solving therapy for Turkish migrants with depression: randomized controlled trial. J Med Internet Res. 2013;15(10):248–62.Google Scholar
  52. Wagner B, Schulz W, Knaevelsrud C. Efficacy of an internet-based intervention for posttraumatic stress disorder in Iraq: a pilot study. Psychiatry Res. 2012;195(1–2):85–8.Google Scholar
  53. Harper-Shehadeh M, Heim E, Chowdhary N, Maercker A, Albanese E. Cultural adaptation of minimally guided interventions for common mental disorders: a systematic review and meta-analysis. JMIR Ment Health. 2016;3(3):e44.Google Scholar
  54. Guo Y, Logan HL, Glueck DH, Muller KE. Selecting a sample size for studies with repeated measures. BMC Med Res Methodol. 2013;13(1):1.Google Scholar
  55. Richards D, Timulak L, Hevey D. A comparison of two online cognitive-behavioural interventions for symptoms of depression in a student population: the role of therapist responsiveness. Counselling & Psychotherapy Research. 2013;13(3):184–93.Google Scholar
  56. Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–15.Google Scholar
  57. Kroenke K, Spitzer RL, Williams JB. The phq-9. J Gen Intern Med. 2001;16(9):606–13.Google Scholar
  58. Merz EL, Malcarne VL, Roesch SC, Riley N, Sadler GR. A multigroup confirmatory factor analysis of the patient health Questionnaire-9 among English- and Spanish-speaking Latinas. Cult Divers Ethn Minor Psychol. 2011;17(3):309–16.Google Scholar
  59. Gilbody S, Richards D, Brealey S, Hewitt C. Screening for depression in medical settings with the patient health questionnaire (PHQ): a diagnostic meta-analysis. J Gen Intern Med. 2007;22(11):1596–602.Google Scholar
  60. Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, et al. Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med Care. 2008;46(3):266–74.Google Scholar
  61. Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.Google Scholar
  62. García-Campayo J, Zamorano E, Ruiz MA, Pardo A, Pérez-Páramo M, López-Gómez V, Freire O, Rejas J. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health and Quality of Life Outcomes. 2010;8(1):8:1-11.Google Scholar
  63. Llewelyn SP. Psychological therapy as viewed by clients and therapists. Br J Clin Psychol. 1988;27(3):223–37.Google Scholar
  64. Elliott R, Slatick E, Urman M. Qualitative change process research on psychotherapy: alternative strategies. Psychological Test and Assessment Modeling. 2001;43(3):69.Google Scholar
  65. Richards D, Timulak L. Satisfaction with therapist-delivered vs. self-administered online cognitive behavioural treatments for depression symptoms in college students. British Journal of Guidance & Counselling. 2013;41(2):193–207.Google Scholar
  66. Dey I. Qualitative data analysis: a user friendly guide for social scientists: Routledge; 2003.Google Scholar
  67. Field A. Discovering statistics using SPSS: sage publications; 2009.Google Scholar
  68. Gueorguieva R, Krystal JH. Move over anova: progress in analyzing repeated-measures data andits reflection in papers published in the archives of general psychiatry. Arch Gen Psychiatry. 2004;61(3):310–7.Google Scholar
  69. Cohen J. In: Hillsdale NJ, editor. Statistical power analysis for the behavioral sciences. 2nd edition. Hillsdale, NJ: Lawrence Earlbaum Associates; 1988.Google Scholar
  70. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12.Google Scholar
  71. Verbeke G, Molenberghs G. Linear mixed models for longitudinal data: Springer Science & Business Media; 2009.Google Scholar
  72. Richards D, Timulak L, Doherty G, Sharry J, Colla A, Joyce C, et al. Internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression: protocol for a randomized controlled trial. BMC Psychiatry. 2014;14:147.Google Scholar


© The Author(s). 2018