An Internet-based treatment for flying phobia (NO-FEAR Airlines): study protocol for a randomized controlled trial
© The Author(s). 2016
Received: 23 July 2016
Accepted: 4 August 2016
Published: 20 August 2016
Flying phobia (FP) is a common and disabling mental disorder. Although in vivo exposure is the treatment of choice, it is linked to a number of limitations in its implementation. Particularly important, is the limited access to the feared stimulus (i.e., plane). Moreover, the economic cost of in vivo exposure should be specially considered as well as the difficulty of applying the exposure technique in an appropriate way; controlling important variables such as the duration of the exposure or the number of sessions. ICTs could help to reduce these limitations. Computer-assisted treatments have remarkable advantages in treating FP. Furthermore, they can be delivered through the Internet, increasing their advantages and reaching more people in need. The Internet has been established as an effective way to treat a wide range of mental disorders. However, as far as we know, no controlled studies exist on FP treatment via the Internet. This study aims to evaluate the efficacy of an Internet-based treatment for FP (NO-FEAR Airlines) versus a waiting list control group. Secondary objectives will be to explore two ways of delivering NO-FEAR Airlines, with or without therapist guidance, and study the patients’ acceptance of the program. This paper presents the study protocol.
The study is a randomized controlled trial. A minimum of 57 participants will be randomly assigned to three conditions: a) NO-FEAR Airlines totally self-applied, b) NO-FEAR Airlines with therapist guidance, or c) a waiting list control group (6 weeks). Primary outcomes measures will be the Fear of Flying Questionnaire-II and the Fear of Flying Scale. Secondary outcomes will be included to assess other relevant clinical measures, such as the Fear and Avoidance Scales, Clinician Severity Scale, and Patient’s Improvement scale. Analyses of post-treatment flights will be conducted. Treatment acceptance and preference measures will also be included. Intention-to-treat and per protocol analyses will be conducted.
An Internet-based treatment for FP could have considerable advantages in managing in vivo exposure limitations, specifically in terms of access to treatment, acceptance, adherence, and the cost-effectiveness of the intervention. This is the first randomized controlled trial to study this issue.
Clinicaltrials.gov: NCT02298478. Trial registration date 3 November 2014.
KeywordsInternet-based exposure Virtual reality Randomized controlled trial Flying phobia Self-help
Flying Phobia (FP) is a common and disabling disorder classified as a situational specific phobia . The symptoms of FP can encompass several diagnostic categories (such as panic disorder, agoraphobia, claustrophobia, or acrophobia), making diagnosis and treatment complex [2, 3]. Recent studies have established a lifetime prevalence of approximately 2.5 % of the adult population , although previous epidemiological studies reported prevalence estimates ranging from 10 to 40 % [5, 6]. Moreover, research has pointed out that around 25 % of the adult population suffers from anxiety when taking a flight, about 10 % avoid flying due to the intensity of their fear, and approximately 20 % depend on alcohol or anxiolytics to fly .
Consequences of FP are far-reaching, resulting in substantial social costs from the patient’s perspective, which for some authors are incalculable , as well as the costs for aeronautical companies [9, 10]. Interference caused by this problem is diverse and varies depending on personal demands or needs, as well as patients’ geographical location. According to Busscher et al. , 7 % of the population experience serious interference in daily life and social functioning due to FP. Personal consequences of suffering from FP may consist of limited professional opportunities or leisure options and changing or disrupted relationships, and it often causes shame and emotional distress when the person faces the thought of flying [4, 11, 12].
There are evidence-based psychological interventions for FP [13, 14], and the most effective treatment approach for this problem is in vivo exposure . Studies report that more than 90 % of participants whose treatment included in vivo exposure continued to fly at one- to four-year follow-up . However, this technique is linked to a number of limitations in its implementation, related to access and acceptance by patients and therapists . With regard to treatment accessibility, most people suffering from phobias never seek help , only 7.8 % search for a treatment , and only 8 % of patients receive a specific treatment for their problem . There could be several reasons for this, such as long waiting lists, lack of evidence-based treatment offered by healthcare systems, and insufficient therapist training to apply the exposure technique [19–21]. As for patients’ acceptance of in vivo exposure, around 25 % reject the treatment when they are informed about the procedure, or they drop-out during treatment [15, 22]. In addition, some authors have considered exposure to be a cruel cure, inhumane, and ethically inappropriate [15, 23]. Furthermore, in vivo exposure involves lack of confidentiality or high associated costs when it has to be conducted outside the therapist’s office . And, finally, but particularly important in FP, is the limited access to the feared stimulus (i.e., airport or plane) . Moreover, for this specific phobia the economic cost of in vivo exposure should be specially considered as well as the difficulty of applying the exposure technique in an appropriate way; that is, controlling important variables such as the duration of the exposure or the number of sessions.
According to Kazdin , there is a need for new models to deliver mental health and reduce the burdens of mental illness. In the case of FP treatment, it is necessary to improve exposure therapy in terms of adherence and acceptance, and help to reach a higher number of patients than with traditional face to face therapy. Information and Communication Technologies (ICTs) can be useful in this endeavor. Specifically, Computer-assisted treatments such as virtual reality exposure therapy (VRET) and computer-assisted exposure have noteworthy advantages in treating FP. Some of these advantages are: providing an intermediate step between the therapist’s office and the real world; the possibility of standardizing treatment as much as possible with a steep exposure gradient; its low cost and accessibility for patients who would not be very willing to subject themselves to live exposure (a real flight); a reduction in direct therapeutic contact time; confidentiality compared to in vivo exposure conducted in a public place; and better acceptance by patients and therapists because it evokes lower anxiety levels [13, 25–27].
VRET has been shown to be effective for FP treatment in several meta-analyses and systematic reviews [28–31]. Regarding computer-assisted exposure programs for FP, the literature shows only one system that has efficacy data. Bornas et al. (2001) developed a computer-assisted exposure program (Computer Assisted Fear of Flight Treatment, CAFFT) that has been shown to be effective in several studies [27, 32]. In this regard, Tortella-Feliu et al.  pointed out that the CAFFT program (with therapist presence and self-administered in the lab) and a VR system  equally reduced FP outcomes at post-treatment and 1-year follow-up. These data suggest that less sophisticated and cheaper devices might be sufficient to produce satisfactory outcomes.
On the other hand, this type of computer-assisted treatment can be delivered through the Internet, which would improve the advantages of this way of applying exposure, reaching more people in need. The Internet has been shown to be an effective tool for treating a broad range of psychological disorders and psychiatric conditions, particularly depression and anxiety disorders [33–35], and it can address common treatment barriers such as limited access to mental health treatments . Specifically, authors have pointed out five main advantages: efficacy, effectiveness, safety, geographical reach, acceptability, and convenience . However, according to Andersson , in spite of the fact that specific phobias are common, only two studies with self-help Internet-based programs have been published, one on spider phobia  and one on snake phobia .
However, despite the proven efficacy of these programs, there are still some questions that remain unclear, such as the impact of clinician guidance. To date, evidence shows that guidance is a beneficial feature that leads to better adherence and better outcomes in programs administered through the Internet [34, 39–41]. Nevertheless, other authors have shown that unguided self-help interventions are useful alternatives with similar outcomes that might work using automated reinforcement [40, 42, 43]. Moreover, the results so far indicate a small but significant effect size of these self-help interventions compared to a control condition [43–47]. Therefore, more research is needed to examine and determine critical key aspects of clinician guidance that promote positive effects .
In sum, the Internet is a useful and effective tool for providing psychological treatments, and there is a large body of research about this topic. However, no published study has explored these issues in the research on FP. As far as we know, no controlled FP study has been published to test the efficacy of an Internet-based treatment.
The purpose of the randomized control trial (RCT) described in this study protocol is to investigate the effectiveness of an Internet-based exposure treatment for FP (NO-FEAR Airlines) versus a waiting list control group. Secondary objectives are: a) to explore two ways of delivering NO-FEAR Airlines, with or without therapist guidance, and b) to study the patients’ acceptance through expectations, preferences, and satisfaction with the online program. This paper presents the study design.
Sample size and power calculations
Power calculations and Internet dropout rates (30 %) [51, 52] were taken into consideration to estimate the necessary sample size to detect a large effect size (d = 1) with a power of 0.80 and an alpha of 0.05, based on a similar study  and recent systematic reviews . The RCT will recruit a minimum of 57 participants, who will be randomly allocated to one of 3 experimental conditions.
This trial received approval from the Ethics Committee of Universitat Jaume I (Castellón, Spain) (20 December 2014) and will be conducted in compliance with the study protocol, the Declaration of Helsinki, and good clinical practice. Data security/confidentially will be guaranteed; all relevant EU and Spanish legislation on privacy will be observed and respected. Access to the Internet platform is through a unique username-password combination, and all transferred data will be secured following the AES (Advanced Encryption Standard) polynomial m(x) = ×8 + ×4 + ×3 + × + 1. The consent form will be explained and required from all participants. Important protocol modifications will be communicated to relevant parties (i.e., trial participants, trial registries, journals, ethical committee and researchers).
The study sample will consist of adults from 18 years old who meet the Diagnostic and Statistical manual for Mental Health Disorders-Version 5 (DSM-5) (APA, 2013) criteria for specific, situational phobia (FP). They are required to have adequate knowledge to understand and read Spanish, access to the Internet, and the ability to use a computer. Exclusion criteria for the study are as follows: a) receiving psychological treatment for FP; b) diagnosis of a severe mental disorder: abuse or dependence on alcohol or other substances, psychotic disorder, dementia or bipolar disorder; c) presence of depressive symptomatology, suicidal ideation or plan; d) Presence of heart disease; e) Pregnant women (from the fourth month). Receiving pharmacological treatment is not an exclusion criterion during the study period, but any increase and/or change in the medication during the study period will imply the participant’s exclusion from subsequent analyses. A decrease in pharmacological treatment is accepted.
Participants with comorbid and related disorders (i.e., panic disorder, agoraphobia, claustrophobia or acrophobia) will be included when FP is the primary diagnosis. Participants who do not meet the inclusion criteria will be encouraged to seek treatment alternatives better suited to their specific needs.
Recruitment, randomization and blinding
The study will be advertised online via professional websites (i.e., LinkedIn), non- professional social-networks (i.e., Facebook and twitter), and advertisements in newspapers. Furthermore, posters will be placed in local universities (Universitat Jaume I and Universitat de València) and travel agencies. People who are interested will be directed to the research website (www.fobiavolar.es), where they will find further information about the study and what participation entails, as well as an informed consent form. Individuals can request participation through the website and by signing the informed consent form. After website registration, the clinical team will contact participants by telephone to screen for the inclusion and exclusion criteria and explain the research terms (i.e., study design, treatment length, or treatment rationale). Participants who meet the criteria will be administered a diagnostic telephone interview at the time of the screening, or another time will be arranged. Then, participants will be randomly assigned to one of the three experimental groups. The allocation schedule will be generated through a computer randomization program (Epidat 4.0) by an independent researcher who will be unaware of the characteristics of the study. The allocation schedule will be communicated to the study researchers via phone call. Patients will agree to participate before the random allocation and without knowing to which treatment they will be assigned. However, for practical reasons, participants and researchers will not be blind to the treatment conditions. Participants will be free at any time to withdraw from the treatment or the study without giving any explanation.
NO-FEAR Airlines is a computer-aided exposure treatment program for FP that can be self-administered via the Internet . This program allows people who are afraid of flying to be exposed to images and sounds related to their phobic fears on a standard personal computer from home. NO-FEAR Airlines was developed by LabPsiTec (Laboratory of psychology and technology, Universitat Jaume I, and University of Valencia) in collaboration with LabCDS (University of Balearic Islands). It is a new version based on a previous program Computer Assisted Fear of Flight Treatment (CAFFT), created by the LabCSD research group [54, 55], and designed to be completely self-applied over the Internet.
NO-FEAR Airlines includes both an assessment protocol and a treatment protocol. The assessment protocol provides a short screening with 19 questions about FP, related problems (i.e., claustrophobia, panic disorder, agoraphobia, and acrophobia), and exclusion criteria. After that, the program carries out a pre-treatment evaluation that includes primary and secondary outcome measures. The treatment protocol consists of 3 therapeutic components: psychoeducation, exposure, and overlearning. These three key aspects are based on techniques that have been shown to be effective and conform to recommendations from guidelines on good clinical practice published by international psychology associations such as the American Psychological Association (APA) (www.apa.org) and the National Institute for Health and Clinical Excellence (NICE) (www.nice.org.uk).
The Psychoeducation component provides information about what the program will contain, as well as specific information related to FP. Specifically, the program teaches: how many people are affected by the problem; what kinds of people are affected; the physiological, cognitive, and behavioral (or avoidance) components of FP; how it begins and is maintained; and how to cope with the problem. This section contains text, vignettes, and illustrations, in order to make the therapeutic content more attractive to the patient.
Exposure is conducted through 6 scenarios composed of images and real sounds related to the flight process: (1) flight preparation, (2) airport, (3) boarding and taking off, (4) the central part of the flight, (5) the airplane’s descent, approach to the runway, and landing, (6) sequences with images and auditory stimuli related to plane crashes. During the exposure scenarios, the system asks (every 3 min) the participant about his/her maximum anxiety level experienced on a scale ranging from 0 “no anxiety” to 10 “high anxiety”. Exposure to each stage ends when the participant indicates an anxiety level lower than 3, in order to achieve the habituation process. Each exposure scenario contains a maximum of 20 cycles (1 cycle consists of images and sounds for 3 min). If the participant exceeds the maximum, the scenario will be presented again at the end. It is possible to take a break from the exposure and between scenarios; however, the program will not advance to the next scenario until the user overcomes the current stage (anxiety level under 3).
The length of the treatment depends on the pace of each patient. Patients will be advised to carry out about two exposures scenarios per week, taking a few days off between sessions. It is estimated that the treatment can be completed in three or four weeks, with a maximum period of six weeks. However, each participant will be free to advance at his/her own pace. Furthermore, after the program, all the patients will be encouraged to take a real flight. NO-FEAR Airlines provides guidelines to cope with this test flight through downloadable material. At the end of the treatment, the system provides post-treatment and 3- and 12-month follow-up assessments.
The program described will be implemented in two formats: 1) NO-FEAR Airlines completely self-applied. Participants who meet the inclusion criteria and after having signed the informed consent form, will access the program and self-administer the treatment following the guidelines described above. In this treatment condition, participants will only receive automatic support provided by the program. Technical assistance (i.e., web accessibility problems or forgotten password) will be provided if necessary. 2) NO-FEAR Airlines with therapist guidance. In this case, participants will also self-administer the treatment via the Internet, and they will receive minimal therapist support. Guidance content will be standardized, although it can be tailored to individual patients’ needs. Therapist guidance will consist of a brief weekly phone call (maximum 5 min) aimed to assess and guide the participant’s progress by providing feedback and reinforcement. In addition, the therapist will check for any problems and remind the participant about the recommended treatment pace. Patients can receive up to 6 telephone calls over a 4 to 6 week period, and so they have a maximum of 30 min of therapeutic support. Trained and experienced psychologists will provide the telephone support. Support calls in any case will have additional clinical content.
Study measures, time of assessment, and source of measurement
Time of assessment
Source of measurement
BL, post-T and FU
Gender, age, education, occupation, marital status
Severity of the FP
BL, post-T and FU
Severity of the FP
BL, post-T and FU
Fear and Avoidance Scales
Fear avoidance, and the degree of belief in catastrophic thought related to the main target behavior.
BL, post-T and FU
Clinician Severity Scale
severity of the patient’s phobia
BL, post-T and FU
Patient’s Improvement Scale
Patient’s improvement assessment
BL, post-T and FU
Treatment Preferences Questionnaire
Participant’s treatment preferences
BL, post-T and FU
Expectations and satisfaction with the treatment
BL, post-T and FU
Measures related to flying phobia
Duration of the problem, flights taken, Safety behaviors, presence of negative experience flying.
BL, post-T and FU
Anxiety during exposure
Maximum level of anxiety experienced during the exposure scenarios
During exposure scenarios
Cycles of exposure scenarios
Number of cycles in each exposure scenario
After exposure scenarios
The Anxiety Disorders Interview Schedule for DSM-IV-TR (ADIS-IV) . The section on specific phobias will be used. Moreover, DSM-5 criteria will be considered. In cases of comorbidity, other sections of the ADIS-IV (i.e., panic disorder or agoraphobia) will be used. ADIS-IV is an excellent interview for assessing anxiety disorders and has adequate psychometric properties .
The Fear of Flying Questionnaire-II (FFQ-II)  is a 30-item self-report instrument that describes situations related to flying: anxiety during flight, anxiety experienced getting on the plane, and anxiety experienced during the observation of neutral or unpleasant flying-related situations. For each item, respondents rated their degree of discomfort associated with the situation on a scale from 1 to 9 (1 = not at all, 9 = very much). Scores ranged from 30 to 270. As reported by Bornas et al. , internal consistency was α = .97, and retest reliability (15-day retest period) was r = .92.
The Fear of Flying scale (FFS)  is a 21-item self-report measure to assess fear associated with various air travel situations. Fear elicited by each situation was rated on a 5-point scale (0 = not at all, 4 = very much), with scores ranging from 0 to 84. For the original FFS , Cronbach’s alpha was .94, and retest reliability (at three months) was .86.
The following socio-demographic variables will be collected: gender, age, marital status, educational level, and work status.
Other relevant clinical measures
Fear and Avoidance Scales (adapted from Marks & Mathews ) are used to assess participants’ fear and avoidance on a scale ranging from 0 (“No fear at all,” “I never avoid”) to 10 (“Severe fear,” “I always avoid”) related to the main target behavior: “flying”. The degree of belief in the catastrophic thought related to the target behavior will also be assessed on a 0 (“I do not believe the thought at all”) to 10 (the thought is totally true) scale.
The Clinician Severity Scale (adapted from Di Nardo, Brown & Barlow ). The clinician rates the severity of the patient’s phobia on a scale from 0 to 8, where 0 = symptom free and 8 = extremely severe.
The Patient’s Improvement Scale (Adapted from the Clinical Global Impression scale, CGI; Guy ). One item on the CGI scale was adapted in order to assess the level of improvement achieved by the patient (compared to the baseline status) on a 7-point scale (1 “much worse” to 7 “much better”). This scale is answered by the patient.
Other measures recorded by the system
Measures related to FP
NO-FEAR Airlines provides a short assessment of fear and avoidance of flying and checks the following issues: the duration of the problem, how many times the patient has taken a flight, whether safety behaviors were used (e.g., alcohol intake, distraction), and whether the participant has had any negative experiences with flying.
Maximum level of anxiety experienced during the exposure scenarios
During exposure to the scenarios, the system asks the user about the maximum anxiety experienced every 3 min, on a scale from 0 “No anxiety” to 10 “maximum anxiety”. The exposure session ends when the anxiety level is less than 3.
Number of cycles in each exposure scenario
The NO-FEAR Airlines system also records the numbers of cycles participants perform in each exposure scenario. One cycle consists of an exposure duration of 3 min.
Treatment acceptance measures
Treatment Expectations and satisfaction scales (adapted from Borkovec & Nau) . This questionnaire measures participants’ expectations before treatment and their satisfaction with it. It includes six items rated from 0 (‘not at all’) to 10 (‘very much’); questions address how logical the treatment seems, to what extent the patient expected to be satisfied with it, whether the patient would recommend the treatment to others, whether it would be useful in treating other problems, the treatment’s usefulness for the patient’s problem, and to what extent it could be aversive. Participants will answer the Expectations scale after the therapist explains the rationale for the treatment they would receive (with or without therapist support) and before beginning the treatment. The satisfaction scale will be completed once treatment is finished. This adaptation has been used in previous studies [64, 65].
Treatment preferences questionnaire
This instrument was specifically developed for this research. It is composed of 5 questions designed to measure participants’ preferences about both treatment conditions included in this study (with and without therapist support): (1) Preference (“If you could have chosen between the two treatments, which one would you have chosen?”; (2) Subjective effectiveness (“Which of these two treatments do you think would have been the most effective in helping you to overcome your problem?”; 3) Logic (Which of these two treatments do you think would have been the most logical to help you overcome your problem); (4) Subjective aversion (“Which of these two treatments do you think would have been the most aversive?”) and (5) Recommendation (“Which of these two treatments would you recommend to a friend with the same problem you have?”). Questions have two response options in accordance with the two treatment conditions. This scale will be completed before participants know the treatment condition assigned and after treatment.
This interview was also specifically developed for this research. It contains 11 items designed to assess participants’ opinions about the NO-FEAR Airlines program and the support received. The interview includes questions rated on a 1 to 5 scale (1 = very little; 5 = very much) and Dichotomous Questions (“Yes” or “No”). Additionally, options to extend the participants’ qualitative responses are available.
Intention-to-treat (ITT) and per protocol analyses (PPA) will be conducted following the CONSORT recommendations and SPIRIT guidelines for reporting the results [48–50]. Differences in demographic and baseline clinical characteristics will be computed using Chi-square tests for categorical variables and analysis of variance (ANOVA) for continuous data. ANOVA will be conducted to explore the effects of the treatments on all primary and secondary outcomes. Analyses of post-treatment flights will be carried out using Chi-square tests to evaluate group differences, including the number of flights taken and number of safety behaviours performed. Moreover, effect sizes and confidence intervals of the mean will be conducted, following the author’s recommendations and recent literature [66, 67]. Assuming that missing data will be missing at random, it will be handled using multiple imputations (MI) . All analyses will be conducted using IBM SPSS statistics for Windows, version 22.
In any case, the state of the art of analytic methodology for RCT will be reviewed before analyzing the data, in order to apply the most appropriate statistical analysis procedure.
This study protocol describes a RCT designed to evaluate the effectiveness of an Internet-based exposure treatment for FP (NO-FEAR Airlines), compared to a waiting list group. In addition, two ways of delivering NO-FEAR Airlines (with or without therapist guidance) will be explored and tested. Finally, the patients’ acceptance of this program will be studied.
The use of an Internet-based treatment for FP could have remarkable advantages for overcoming the limitations of exposure in vivo, specifically in terms of access to treatment, acceptance, adherence, and cost-effectiveness of the intervention. These self-applied interventions improve the possibility of reaching people in need, improving the access to evidence-based treatments [33, 36], and opening up the possibility of fully standardizing the treatment [7, 32]. Furthermore, they may have better acceptance among patients and therapists because they produce lower anxiety levels with a steep exposure gradient through simulated environments [22, 36], thus promoting better adherence and avoiding dropouts. Finally, from a cost-effectiveness perspective, the reduction in direct therapeutic contact time is important, as Internet-based self-applied treatments save therapist time compared to traditional, face-to-face treatments . These advantages help to address Kazdin and Blase’s  and Emmelkamp et al.  proposal that psychotherapy research needs to develop interventions that can be applied to more patients in a simpler and more cost-effective way.
Another aim of the present study is to examine the efficacy of a completely self-applied intervention for FP (without therapist guidance, only the initial call phone contact with the therapist) and find out whether this intervention makes it possible to reduce the therapist time even more. In this case, Internet-based interventions would be easier to implement in primary care and, therefore, reach more people in need. As explained above, to date, studies about the relative benefits of guided vs. unguided support in Internet delivered interventions have reached different conclusions. The literature shows that guidance is a beneficial feature resulting in better adherence and better outcomes [34, 39–41]. However, some studies have shown the efficacy of self-guided treatments (without any contact or support from a therapist, consultant or researcher) [43–47, 71]. Furthermore, unguided interventions have been shown to be much easier to implement and less costly than guided web-based interventions , and so it is important to continue to study their effectiveness. Thus, more research is needed to examine this issue .
It is important to highlight that the relative benefits of guided vs. unguided support in Internet delivered interventions for FP remain unexplored. Our data could provide information about this new and necessary topic; showing the possibility and potential of completely self-applied interventions in reducing the cost of treatment for people with FP.
The strengths of this study are: First, this is the first RCT to test an Internet-based exposure treatment for FP. Second, the treatment components (psychoeducation, exposure, and overlearning) are based on effective techniques and conform to the recommendations of the guidelines on good clinical practice (i.e., APA and NICE) [1, 73]. Third, NO-FEAR Airlines is a new version based on the CAFFT program, which has proven its efficacy in different studies for FP treatment . This study will provide additional data for the study of FP treatment using computer-assisted exposure, in line with other authors .
Finally, there are several limitations that should be mentioned. First, the measurements (i.e., diagnostic interview and questionnaires) will be conducted online and via phone calls. Although some studies have shown the utility of online assessment and its concordance with traditional assessment [74–76], some evidence suggests that psychometric properties may change when assessment is conducted via the web . Second, dropout rates are expected to be high (around 30 %), according to the literature [51, 52]. For this reason, dropout rates have been taken into account in the sample size calculation. Third, due to the heterogeneity of FP, the presence of comorbid disorders such as panic, agoraphobia, claustrophobia, and acrophobia may influence the study outcome measures. Although participants with comorbid disorders will not be excluded if FP is the primary diagnosis, this fact will be taken into account in the data analysis.
In summary, the results will contribute to the growing research on Internet-delivered treatments and the treatment of FP. NO-FEAR Airlines is intended to be an effective and useful tool to help people who may need it. This program has been designed to enhance the adherence, acceptance, and access to exposure-based treatments for FP. Finally, results from this study could help to improve the exposure technique application.
Advanced Encryption Standard
Analysis of Variance
American Psychological Association
Computer Assisted Fear of Flying Treatment
Clinical Global Impression scale
Consolidated Standards of Reporting Trials
Diagnostic and Statistical Manual for Mental Health Disorders-Version 5
Fear of Flying Questionnaire-II
Fear of Flying Scale
Information and Communication Technologies
Laboratorio De Conducta Y Sistemas Dinámicos
Laboratory of Psychology and Technology
National Institute for Health and Clinical Excellence
Per Protocol Analyses
Randomized Control Trial
Standard Protocol Items: Recommendations for Interventional Trials
Virtual Reality Exposure Therapy
“Not applicable” in this section.
Funding for the study was provided by grants: Ministerio de Economía y Competitividad (Spain) (Plan Nacional I + D + I. PSI2013-41783-R); Red de Excelencia (PSI2014-56303-REDT) PROMOSAM: Research in processes, mechanisms and psychological treatments for mental health promotion from the Ministerio de Economía y Competitividad (2014); a PhD grant from Generalitat Valenciana (VALi + d) (ACIF/2014/320), and CIBER: CIBER Fisiopatología de la Obesidad y Nutrición is an initiative of ISCIII.
Availability of data and material
It is not possible to share the data because the study is in progress. We are now at the stage of data recruitment. Only principal investigators will have access to the final trial dataset and it will be considered to publish.
Trial results will be communicated to participants, healthcare professionals, the public, and other relevant groups (i.e., via professional websites, non-professional social-networks, and announcements in newspapers). The research team will make the findings publicly available at national and international conferences, and in peer-reviewed journal publications.
DCa drafted the manuscript with important contributions from SQ, JB-L and CB. DCa, in collaboration with SQ and JB-L designed the study and participated in each of its phases. AM collaborated in the manuscript development and participated in each study phase. CB, DCb, RB and MT-F carried out the Internet based adaptation of the treatment protocol with important contributions of SQ and JB-L. All authors participated in the review and revision of the manuscript and have approved the final manuscript to be published.
DCa is PhD student at Universitat Jaume I in the Department of Basic and Clinical Psychology and Psychobiology, who is currently holding a grant by Generalitat Valenciana (VALi + d) (ACIF/2014/320). DCa is also member of Labpsitec. JB-L is an associate professor of Clinical Psychology at Universitat Jaume I in the Department of Basic and Clinical Psychology and Psychobiology, and she is also member of Labpsitec. CB is full professor of Clinical Psychology at Universitat Jaume I in the Department of Basic and Clinical Psychology, and Psychobiology. She is also the Director of Labpsitec (www.labpsitec.com), and Head of a CIBER group (Centre for Network Biomedical Research) group in the area of Biomedicine and Health Sciences (http://www.ciberisciii.es/areas-tematicas/ciberobn). CB is also director of the Doctoral Program in Psychology at Universitat Jaume I. AM is PhD in Psychology by Universitat Jaume I and researcher at Labpsitec. DCb is PhD in Psychology by Universitat Jaume I and senior researcher in Cognitive Ergonomics and Usability at Labpsitec. RB is full professor at the Universitat de València, in the Department of Personality, Evaluation and Psychological Treatments, and she is member of Labpsitec. MT-F is Clinical Psychologist, Ph.D, Senior Lecturer at University of the Balearic Islands and also member of LabCSD (http://labcsd.uib.cat/). SQ is Professor of Clinical Psychology at Universitat Jaume I, in the Department of Basic and Clinical Psychology and Psychobiology. She is also Vice-Dean of Masters at the Faculty of Health Sciences, co-director of the Master in General Health Psychology at Universitat Jaume I and member of Labpsitec.
The authors declare that they have no competing interests.
Consent for publication
“Not applicable” in this section.
Ethics approval and consent to participate
We confirm that any aspect of the work covered in this manuscript that has involved human patients has been conducted with the ethical approval of all relevant bodies and that such approvals are acknowledged within the manuscript. The study was approved by the Ethics Committee of Universitat Jaume I (Castellón, Spain) (20 December 2014). All participants interested in participating will sign an informed consent form.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Washington, D.C.: Elsevier; 2013.View ArticleGoogle Scholar
- Busscher B, Spinhoven P, van Gerwen L, de Geus E. Anxiety sensitivity moderates the relationship of changes in physiological arousal with flight anxiety during in vivo exposure therapy. Behav Res Ther. 2013;51(2):98–105. http://dx.doi.org/10.1016/j.brat.2012.10.009.View ArticlePubMedGoogle Scholar
- Van Gerwen LJ, Spinhoven P, Diekstra RFW, Van Dyck R. People who seek help for fear of flying: Typology of flying phobics. Behav Ther. 1997;28(2):237–51. http://dx.doi.org/10.1016/s0005-7894(97)80045-7.View ArticleGoogle Scholar
- Oakes M, Bor R. The psychology of fear of flying (part I): A critical evaluation of current perspectives on the nature, prevalence and etiology of fear of flying. Travel Med Infect Dis. 2010;8(6):327–38. http://dx.doi.org/10.1016/j.tmaid.2010.10.001.View ArticlePubMedGoogle Scholar
- Agras S, Sylvester D, Oliveau D. The epidemiology of common fears and phobia. Compr Psychiatry. 1969;10(2):151–6. http://dx.doi.org/10.1016/0010-440x(69)90022-4.View ArticlePubMedGoogle Scholar
- Van Gerwen L, Diekstra R, Arondeus J, Wolfger R. Fear of flying treatment programs for passengers: an international update. Travel Med Infect Dis. 2004;2(1):27–35. http://dx.doi.org/10.1016/j.tmaid.2004.01.002.View ArticlePubMedGoogle Scholar
- Botella C, Osma J, Garcia-Palacios A, Quero S, Baños R. Treatment of flying phobia using virtual reality: data from a 1-year follow-up using a multiple baseline design. Clin Psychol Psychother. 2004;11(5):311–23. http://dx.doi.org/10.1002/cpp.404.View ArticleGoogle Scholar
- Wiederhold B, Gevirtz R, Spira J. Virtual reality exposure therapy vs. imagery desensitization therapy in the treatment of flying phobia. In: Riva G, Galimberti C, editors. Towards CyberPsychology: mind, cognition, and society in the internet age. Amsterdam: Ios Press; 2001. p. 254–72.Google Scholar
- Iljon Foreman E, Bor R, Van Gerwen LJ. The nature, characteristics, impact and personal implications of fear of flying. In: Bor R, Hubbard T, editors. Aviation mental health. Aldershot: Ashgate; 2006. p. 53–68.Google Scholar
- Roberts RJ. Passenger fear of flying: Behavioural treatment with extensive in-vivo exposure and group support. Aviat Space Environ Med. 1989;60(4):342–8.PubMedGoogle Scholar
- Bor R. Psychological factors in airline passenger and crew behaviour: a clinical overview. Travel Med Infect Dis. 2007;5(4):207–16. http://dx.doi.org/10.1016/j.tmaid.2007.03.003.View ArticlePubMedGoogle Scholar
- Iljon Foreman E, Bor R, Van Gerwen L. Flight or fright? psychological approaches to the treatment of fear of flying. In: Bor R, Hubbard T, editors. Aviation mental health: psychological implications for air transportation. London: Ashgate; 2006. p. 69–83. In Press.Google Scholar
- Rothbaum B, Anderson P, Zimand E, Hodges L, Lang D, Wilson J. Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment of fear of flying. Behav Ther. 2006;37(1):80–90. http://dx.doi.org/10.1016/j.beth.2005.04.004.View ArticlePubMedGoogle Scholar
- Van Gerwen L, Spinhoven P, Diekstra R, Van Dyck R. Multicomponent standardized treatment programs for fear of flying: Description and effectiveness. Cogn Behav Pract. 2002;9(2):138–49. http://dx.doi.org/10.1016/s1077-7229(02)80007-4.View ArticleGoogle Scholar
- Olatunji B, Deacon B, Abramowitz J. The cruelest cure? ethical issues in the implementation of exposure-based treatments. Cogn Behav Pract. 2009;16(2):172–80. http://dx.doi.org/10.1016/j.cbpra.2008.07.003.View ArticleGoogle Scholar
- Boyd JH, Rae DS, Thompson JW, Burns BJ, Bourdon K, Locke BZ, Regier DA. Phobia: prevalence and risk factors. Soc Psych Psych Epid. 1990;25(6):314–23. http://dx.doi.org/10.1007/bf00782887.View ArticleGoogle Scholar
- Mackenzie C, Reynolds K, Cairney J, Streiner D, Sareen J. Disorder-specific mental health service use for mood and anxiety disorders: associations with age, sex, and psychiatric comorbidity. Depress Anxiety. 2012;29(3):234–42. http://dx.doi.org/10.1002/da.20911.View ArticlePubMedGoogle Scholar
- Stinson F, Dawson DA, Chou SP, Smith S, Goldstein R, Ruan W, Grant BF. The epidemiology of DSM-IV specific phobia in the USA: results from the national epidemiologic survey on alcohol and related conditions. Psychol Med. 2007;37(07):1047. doi:10.1017/S0033291707000086.View ArticlePubMedGoogle Scholar
- Kazdin A, Blase S. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci. 2011;6(1):21–37. http://dx.doi.org/10.1177/1745691610393527.View ArticlePubMedGoogle Scholar
- Kazdin A, Rabbitt S. Novel models for delivering mental health services and reducing the burdens of mental illness. Clin Psychol Sci. 2013;1(2):170–91. http://dx.doi.org/10.1177/2167702612463566.View ArticleGoogle Scholar
- Kazdin A. Evidence-based psychotherapies II: changes in models of treatment and treatment delivery. S Afr J Psychology. 2014;45(1):3–21. http://dx.doi.org/10.1177/0081246314538733.Google Scholar
- Garcia-Palacios A, Botella C, Hoffman H, Fabregat S. Comparing acceptance and refusal rates of virtual reality exposure vs. In vivo exposure by patients with specific phobias. Cyberpsychol Behav. 2007;10(5):722–4. http://dx.doi.org/10.1089/cpb.2007.9962.View ArticlePubMedGoogle Scholar
- Deacon BJ, Farrell N. Therapist barriers in the dissemination of exposure therapy. In: Storch E, McKay D, editors. Treating variants and complications in anxiety disorders. New York: Springer Press; 2013. p. 363–73.View ArticleGoogle Scholar
- Rothbaum B, Hodges L, Smith S, Lee J, Price L. A controlled study of virtual reality exposure therapy for the fear of flying. J Consult Clin Psychol. 2000;68(6):1020–6. http://dx.doi.org/10.1037/0022-006x.68.6.1020.View ArticlePubMedGoogle Scholar
- Baños RM, Botella C, Perpiñá C. Virtual reality and psychopathology. Cyberpsychol Behav. 1999;2(4):283–92. http://dx.doi.org/10.1089/cpb.1999.2.283.View ArticlePubMedGoogle Scholar
- Botella C, Gallego MJ, Garcia-Palacios A, Guillen V, Baños RM, Quero S, et al. An Internet-Based Self-Help Treatment for Fear of Public Speaking: A Controlled Trial. Cyberpsychol Behav. 2010;13(4):407–21: http://dx.doi.org/10.1089/cyber.2009.0224.View ArticleGoogle Scholar
- Tortella-Feliu M, Bornas X, Llabrés J. Computer-assisted exposure treatment for flight phobia. Int J Behav Consult Ther. 2008;4(2):158–71. http://dx.doi.org/10.1037/h0100840.View ArticleGoogle Scholar
- Diemer J, Mühlberger A, Pauli P, Zwanzger P. Virtual reality exposure in anxiety disorders: Impact on psychophysiological reactivity. World J Biol Psychiatry. 2014;15(6):427–42. http://dx.doi.org/10.3109/15622975.2014.892632.View ArticlePubMedGoogle Scholar
- Gregg L, Tarrier N. Virtual reality in mental health. Soc Psychiatry Psychiatr Epidemiol. 2007;42(5):343–54. http://dx.doi.org/10.1007/s00127-007-0173-4.View ArticlePubMedGoogle Scholar
- Meyerbröker K, Emmelkamp P. Virtual reality exposure therapy in anxiety disorders: a systematic review of process-and-outcome studies. Depress Anxiety. 2010;27(10):933–44. http://dx.doi.org/10.1002/da.20734.View ArticlePubMedGoogle Scholar
- McCann R, Armstrong C, Skopp N, Edwards-Stewart A, Smolenski D, June J, et al. Virtual reality exposure therapy for the treatment of anxiety disorders: An evaluation of research quality. J Anxiety Disord. 2014;28(6):625–31. doi:10.1016/j.janxdis.2014.05.010.View ArticlePubMedGoogle Scholar
- Tortella-Feliu M, Botella C, Llabres J, Breton-Lopez J, del Amo A, Banos R, et al. Virtual reality versus computer-aided exposure treatments for fear of flying. Behav Modif. 2011;35(1):3–30. http://dx.doi.org/10.1177/0145445510390801.View ArticlePubMedGoogle Scholar
- Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol. 2016;12(1):157–79. http://dx.doi.org/10.1146/annurev-clinpsy-021815-093006.View ArticlePubMedGoogle Scholar
- Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother. 2012;12(7):861–70. http://dx.doi.org/10.1586/ern.12.63.View ArticlePubMedGoogle Scholar
- Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014;13(1):4–11. http://dx.doi.org/10.1002/wps.20083.View ArticlePubMedPubMed CentralGoogle Scholar
- Andrews G, Newby J, Williams A. Internet-Delivered Cognitive Behavior Therapy for Anxiety Disorders Is Here to Stay. Curr Psychiatry Rep. 2015;17(1):533. http://dx.doi.org/10.1007/s11920-014-0533-1.View ArticlePubMedGoogle Scholar
- Andersson G, Waara J, Jonsson U, Malmaeus F, Carlbring P, Öst L. Internet‐based self‐help versus One‐session exposure in the treatment of spider phobia: a randomized controlled trial. Cogn Behav Ther. 2009;38(2):114–20. http://dx.doi.org/10.1080/16506070902931326.View ArticlePubMedGoogle Scholar
- Andersson G, Waara J, Jonsson U, Malmaeus F, Carlbring P, Öst L. Internet-based exposure treatment versus one-session exposure treatment of snake phobia: a randomized controlled trial. Cogn Behav Ther. 2013;42(4):284–91. http://dx.doi.org/10.1080/16506073.2013.844202.View ArticlePubMedGoogle Scholar
- Andersson G, Carlbring P, Ljótsson B, Hedman E. Guided internet-based CBT for common mental disorders. J Contemp Psychother. 2013;43(4):223–33. http://dx.doi.org/10.1007/s10879-013-9237-9.View ArticleGoogle Scholar
- Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interv. 2014;1(4):205–15. http://dx.doi.org/10.1016/j.invent.2014.08.003.View ArticleGoogle Scholar
- Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–42. http://dx.doi.org/10.1016/j.cpr.2012.02.004.View ArticlePubMedGoogle Scholar
- Titov N, Dear BF, Johnston L, Lorian C, Zou J, Wootton B, et al. Improving Adherence and Clinical Outcomes in Self-Guided Internet Treatment for Anxiety and Depression: Randomised Controlled Trial. Andersson G, editor. PLoS ONE. 2013;8(7):e62873. http://dx.doi.org/10.1371/journal.pone.0062873
- Titov N, Dear B, Johnston L, McEvoy P, Wootton B, Terides M, et al. Improving adherence and clinical outcomes in self-guided internet treatment for anxiety and depression: a 12-month follow-Up of a randomised controlled trial. PLoS One. 2014;9(2):e89591. http://dx.doi.org/10.1371/journal.pone.0089591.View ArticlePubMedPubMed CentralGoogle Scholar
- Berger T, Caspar F, Richardson R, Kneubühler B, Sutter D, Andersson G. Internet-based treatment of social phobia: a randomized controlled trial comparing unguided with two types of guided self-help. Behav Res Ther. 2011;49(3):158–69. http://dx.doi.org/10.1016/j.brat.2010.12.007.View ArticlePubMedGoogle Scholar
- Cuijpers P, Donker T, Johansson R, Mohr D, van Straten A, Andersson G. Self-guided psychological treatment for depressive symptoms: a meta-analysis. PLoS One. 2011;6(6):e21274. http://dx.doi.org/10.1371/journal.pone.0021274.View ArticlePubMedPubMed CentralGoogle Scholar
- Farrer L, Christensen H, Griffiths K, Mackinnon A. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One. 2011;6(11):e28099. http://dx.doi.org/10.1371/journal.pone.0028099.View ArticlePubMedPubMed CentralGoogle Scholar
- Meyer B, Bierbrodt J, Schröder J, Berger T, Beevers C, Weiss M, et al. Effects of an Internet intervention (Deprexis) on severe depression symptoms: Randomized controlled trial. Internet Interv. 2015;2(1):48–59. http://dx.doi.org/10.1016/j.invent.2014.12.003.View ArticleGoogle Scholar
- Eysenbach G. CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res. 2011;13(4):e126. http://dx.doi.org/10.2196/jmir.1923.View ArticlePubMedPubMed CentralGoogle Scholar
- Chan A, Tetzlaff J, Altman D, Laupacis A, Gøtzsche P, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. http://dx.doi.org/10.7326/0003-4819-158-3-201302050-00583.View ArticlePubMedPubMed CentralGoogle Scholar
- Chan A, Tetzlaff J, Gotzsche P, Altman D, Mann H, Berlin J, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586. http://dx.doi.org/10.1136/bmj.e7586.View ArticlePubMedPubMed CentralGoogle Scholar
- Van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit J, et al. Adherence to internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674. http://dx.doi.org/10.1371/journal.pone.0100674.View ArticlePubMedPubMed CentralGoogle Scholar
- Spek V, Cuijpers P, Nyklicek I, Keyzer J, Pop V. Internet-based cognitive behavior therapy for symptoms of depression and anxiety: A meta-analysis. Psychol Med. 2007;37:319–28. http://dx.doi.org/10.1017/s0033291706008944.View ArticlePubMedGoogle Scholar
- Quero S, Campos D, Riera del Amo A, Bretón-López J, Tortella-Feliu M, Baños RM, Botella C. NO-FEAR Airlines: A Computer-aided Self-help Treatment for Flying Phobia. Stud Health Technol Inform. 2015;13:197–201. doi:10.3233/978-1-61499-595-1-197.Google Scholar
- Bornas X, Fullana M, Tortella-Feliu M, Llabrés J, García de la Banda G. Computer-assisted therapy in the treatment of flight phobia: A case report. Cogn Behav Pract. 2001;8(3):234–40. http://dx.doi.org/10.1016/s1077-7229(01)80058-4.View ArticleGoogle Scholar
- Bornas X, Tortella-Feliu M, Llabres J, Mulhberger A, Pauli P, Barcelo F. Clinical usefulness of a simulated exposure treatment for fear of flying. Int J Clin Health Psychol. 2002;2:247–62.Google Scholar
- Brown TA, Barlow DH, Di Nardo PA. Anxiety disorders interview schedule for DSM-IV (ADIS-IV): client interview schedule. New York: Graywind Publications Inc; 1994.Google Scholar
- Antony M, Orsillo SM, Roemer L. Practitioner’s guide to empirically-based measures of anxiety. New York: Kluwer Academic/Plenum Publishers; 2001.Google Scholar
- Bornas X, Tortella-Feliu M, García de la Banda G, Fullana MA, Llabrés J. Validación factorial del cuestionario de miedo a volar (QPV) [The Factor Validity of the Fear of Flying Questionnaire]. Análisis y Modificación de Conducta. 1999;25:885–907.Google Scholar
- Haug T, Brenne L, Johnsen DH, Brentzen D, Götestam KG, Hughdal K. A three systems analysis of fear of flying: A comparison of a consonant versus a non-consonant treatment method. Behav Res Ther. 1987;25:187–94. doi:10.1016/0005-7967(87)90045-3.View ArticlePubMedGoogle Scholar
- Marks IM, Mathews AM. Brief standard self-rating for phobic patients. Behav Res Ther. 1979;17(3):263–7.View ArticlePubMedGoogle Scholar
- Di Nardo PA, Brown TA, Barlow DH. Anxiety disorders interview schedule for DSM-IV: Lifetime version (ADIS-IV-L). New York: Graywind Publications Inc; 1994.Google Scholar
- Guy W. Clinical global impressions. En ECDEU assessment manual for psychopharmacology. Rockville: National Institute for Mental Health; 1976.Google Scholar
- Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry. 1972;3(4):257–60. http://dx.doi.org/10.1016/0005-7916(72)90045-6.View ArticleGoogle Scholar
- Botella C, Gallego MJ, Garcia-Palacios A, Baños RM, Quero S, Alcañiz M. The acceptability of an Internet-based self-help treatment for fear of public speaking. Br J Guid Counc. 2009;37(3):297–311. http://dx.doi.org/10.1080/03069880902957023.View ArticleGoogle Scholar
- Quero S, Pérez-Ara M, Bretón-López J, García-Palacios A, Baños R, Botella C. Acceptability of virtual reality interoceptive exposure for the treatment of panic disorder with agoraphobia. Br J Guid Counc. 2013;42(2):123–37. http://doi.org/10.1080/03069885.2013.852159.View ArticleGoogle Scholar
- Cumming G. The New statistics: why and how. Psychol Sci. 2013;25(1):7–29. http://dx.doi.org/10.1177/0956797613504966.View ArticlePubMedGoogle Scholar
- Cumming G, Calin-Jageman R. Introduction to the new statistics. London: Routledge Taylor & Francis Group; 2016.Google Scholar
- Brunton-Smith IR, Carpenter J, Kenward M, Tarling R. Multiple Imputation for handling missing data in social research. Social Research Update. 2014;65.
- Andrews G, Cuijpers P, Craske M, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196. http://dx.doi.org/10.1371/journal.pone.0013196.View ArticlePubMedPubMed CentralGoogle Scholar
- Emmelkamp P, David D, Beckers T, Muris P, Cuijpers P, Lutz W, et al. Advancing psychotherapy and evidence-based psychological interventions. Int J Methods Psychiatr Res. 2013;23(S1):58–91. http://dx.doi.org/10.1002/mpr.1411.View ArticleGoogle Scholar
- Kelders S, Bohlmeijer E, Pots W, van Gemert-Pijnen J. Comparing human and automated support for depression: Fractional factorial randomized controlled trial. Behav Res Ther. 2015;72:72–80. http://dx.doi.org/10.1016/j.brat.2015.06.014.View ArticlePubMedGoogle Scholar
- Karyotaki E, Kleiboer A, Smit F, Turner D, Pastor A, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an ‘individual patient data’ meta-analysis. Psychol Med. 2015;45(13):2717–26. http://dx.doi.org/10.1017/s0033291715000665.View ArticlePubMedGoogle Scholar
- Clark D. Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: The IAPT experience. Int Rev Psychiatry. 2011;23(4):318–27. http://dx.doi.org/10.3109/09540261.2011.606803.View ArticlePubMedPubMed CentralGoogle Scholar
- Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Öst L, et al. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Comput Human Behav. 2007;23(3):1421–34. http://dx.doi.org/10.1016/j.chb.2005.05.002.View ArticleGoogle Scholar
- Campos D, Quero S, Bretón-López J, Riera del Amo A, Mira A, Tortella-Feliu M, Botella C. Concordancia entre la evaluación psicológica a través de Internet y la evaluación tradicional aplicada por el terapeuta para la fobia a volar. Tesis Psicológica. In press 2016.
- Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, et al. Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation. Comput Human Behav. 2010;26(4):736–40. http://dx.doi.org/10.1016/j.chb.2010.01.010.View ArticleGoogle Scholar
- Buchanan T, Johnson J, Goldberg L. Implementing a Five-Factor Personality Inventory for Use on the Internet. Eur J Psychol Assess. 2005;21(2):115–27. http://dx.doi.org/10.1027/1015-57184.108.40.206.View ArticleGoogle Scholar