- Study protocol
- Open Access
Eye movement desensitization and reprocessing (EMDR) therapy or supportive counseling prior to exposure therapy in patients with panic disorder: study protocol for a multicenter randomized controlled trial (IMPROVE)
BMC Psychiatry volume 23, Article number: 157 (2023)
Exposure-based therapy is the treatment of choice for anxiety disorders, but many patients do not benefit sufficiently from it. Distressing images of threat related to the future or past may maintain the anxiety symptomatology or impede exposure therapy. An intervention that targets threat-related imagery is eye movement desensitization and reprocessing (EMDR) therapy. The main goal of this multicenter randomized controlled trial is to investigate whether EMDR therapy plus exposure therapy, relative to supportive counseling plus exposure therapy, improves treatment efficacy, tolerability, and adherence in patients with panic disorder. In addition, we will examine potential predictors of optimal treatment allocation, mechanisms of change as well as the long term effects of treatment. Finally, we will assess cost-effectiveness.
A multicenter randomized controlled trial mixed design will be conducted. Participants will be 50 patients, aged ≥ 18, diagnosed with a panic disorder. They will be randomly assigned to one of two conditions: EMDR therapy (i.e., flashforward strategy) or supportive counseling (each consisting of four weekly sessions of 90 min each) prior to exposure therapy (consisting of eight weekly sessions of 90 min each). Assessments will be made pre-treatment (T1), between-treatments (T2), post-treatment (T3), one month post-treatment (FU1) and six months post-treatment (FU2) by an assessor blind to treatment condition. The primary outcome measure is severity of panic-related symptoms. Secondary outcome measures are: tolerability of exposure therapy (initial avoidance, willingness to start exposure therapy, considered drop-out; no-show and drop-out), related symptomatology (generalized anxiety, depression), and functional impairment.
The primary goals of this research are to compare the efficacy, tolerability, and adherence of EMDR therapy plus exposure therapy and supportive counseling plus exposure therapy and to identify predictors, moderators, and mediators for treatment success. This multi-center research aims to make a significant contribution to our understanding as to how treatment for patients with anxiety disorders can be optimized, and elucidate who can benefit most from this novel approach.
ISRCTN—ISRCTN29668369: Improving anxiety treatment by modifying emotional memories before real-life exposure. Registered 27 June 2022—retrospectively registered. ISRCTN—ISRCTN29668369.
Anxiety disorders are among the most common mental disorders, with about one out of 14 people meeting diagnostic criteria at any point of time . These disorders comprise panic disorder, agoraphobia, social anxiety disorder, specific phobia, and generalized anxiety disorder. Their key elements are excessive fear in anticipation or the presence of the feared (innocuous) stimulus/stimuli and avoidance of disorder-related situations , which cause personal suffering and/or functional impairment . Annual societal costs associated with anxiety-related disorders are estimated at about €74 billion in the European Union  and $42 billion in the United States .
Cognitive-behavioral therapy (CBT) is the psychological treatment of choice for anxiety disorders recommended in clinical guidelines [e.g., ], and it typically includes a combination of cognitive restructuring and behavioral (e.g., exposure) interventions [6, 7]. During exposure therapy, patients are systematically confronted with stimuli and situations associated with their anxiety disorder (e.g., bodily sensations in case of panic disorder), so that the patient learns that the anticipated feared outcome does not occur (e.g., having a heart attack) . Meta-analyses have shown large effect sizes for CBT in anxiety disorders, especially when exposure strategies are used [9, 10].
A recent meta-analysis, however, shows that exposure-based CBT is moderately efficacious for anxiety disorders compared to other interventions when controlling for non-specific treatment or placebo (pill or psychological) effects . There is substantial room for improvement for at least four reasons. First, about 25–30% of patients refuse to start exposure therapy, because they find it too aversive [11, 12]. Second, about 10–20% of patients drop out prematurely [12,13,14]. Third, although meta-analyses show substantial effect sizes for (exposure-based) CBT, the response rate (i.e., the percentage of patients showing significant clinical improvement) is around 50% . Finally, little research has focused on relapse after (exposure-based) CBT [16,17,18], but recent findings suggest that it occurs in about 14% of cases . Additionally, laboratory research has shown that even when exposure-based training is initially successful, learned fear can later return . Taken together, these results underline the need for treatment optimization.
According to prevailing associative learning theories , the intensity of learned fear is determined by two factors: the strength of threat expectancy (e.g., expecting that dizziness or heart palpitations are harbingers of having a heart attack) and the mental representation of threat intensity (e.g., having a heart attack). Presumably, exposure therapy focuses specifically on the first factor: maximizing violations of threat expectancy . It is not directly aimed at the second factor: the threat intensity representation  such as vivid and upsetting mental imagery of having a heart attack in a supermarket. Such imagery shares similarities with traumatic memories in posttraumatic stress disorder (PTSD) [21, 22]. Indeed, previous research showed that anxiety patients often report vivid and distressing mental images of threat [23, 24], related to past aversive events (“flash-backs”) or, likely more importantly, anticipated future threat (i.e., “flash-forwards”) [25, 26].
If patients with anxiety disorders experience intense threat imagery, they might be too anxious [27, 28] or unwilling to confront feared stimuli [28,29,30], which could explain the low attrition rates in exposure therapy. Interestingly, laboratory fear conditioning studies have shown that an imagery intervention to modulate threat imagery enhances extinction learning and reduces return of fear [31,32,33]. Preliminary research has also shown promising results of clinical interventions that specifically focus on threat imagery in anxiety disorders, such as imagery rescripting [34,35,36,37] or EMDR therapy [38,39,40].
EMDR therapy was developed to alleviate the distress associated with traumatic memories . During EMDR therapy, patients recall a traumatic memory while simultaneously focusing on another task (such as making eye movements by tracking the therapist’s fingers). A large body of experimental research suggests that the emotional intensity and vividness of aversive memories can be reduced when the person performs a distracting task that taxes working memory while recalling the aversive memory [42,43,44]. Because similar neural mechanisms are involved in past and future memories , EMDR therapy may also be effective to modulate fear-related future memories. Pre-clinical laboratory research has indeed shown that an EMDR lab analog modulates future-oriented threat memories [26, 46, 47]. Accordingly, a clinical EMDR “flash-forward” protocol has been developed .
Several randomized controlled trials found that EMDR therapy focused on past aversive events reduces anxiety symptoms [39, 40], but the majority have methodological limitations, including the risk of bias, small samples, and the lack of an active control condition [38, 40]. No research so far has tested whether modulation of flashforwards reduces anxiety symptoms in itself and/or enhances efficacy, tolerability, and adherence of exposure-based therapy in patients with anxiety disorder. The primary aim of the present study is to test the efficacy, tolerability, and adherence of this promising approach [23, 49]. To control for nonspecific factors, we will use an active, nonspecific and nondirective intervention aimed at offering support (supportive counseling) . Patients with panic disorder will be the focus of the study, because mental images of threat are prominent in this disorder . Furthermore, panic disorder is prevalent, which enhances the study’s feasibility .
Goals of the current study:
The main goal of this multicenter Randomized Controlled Trial is to investigate whether EMDR therapy with exposure therapy, relative to supportive counseling with exposure therapy, improves treatment efficacy, tolerability, and adherence in patients with panic disorder. The primary outcome measures are panic-related symptoms. Secondary outcome measures are: tolerability of exposure therapy (initial avoidance, willingness to start exposure therapy, considered drop-out; no-show and drop-out), related symptomatology (generalized anxiety, depression) and functional impairment. We hypothesize that: (1) EMDR therapy will be more effective in reducing panic-related symptoms, compared to supportive counselling from baseline (T1) to between-treatments (T2). (2) EMDR therapy + exposure therapy will be more effective in reducing panic-related symptoms, compared to supportive counseling + exposure therapy at post-treatment (T3). (3) EMDR therapy will result in higher tolerability of exposure therapy (less initial avoidance, more willingness to start exposure therapy, less considered drop-out; less no-show and actual drop-out) compared to supportive counseling. We further hypothesize that: (4) EMDR therapy will be more effective in reducing related symptomatology (generalized anxiety, depression) and functional impairment, compared to supportive counseling from baseline (T1) to between-treatments (T2). And (5) EMDR therapy + exposure therapy will be more effective in reducing related symptomatology (generalized anxiety, depression) and personal suffering/functional impairment, compared to supportive counseling + exposure therapy at post-treatment (T3).
Hypotheses concerning the following secondary goals will be preregistered on the Open Science Framework . The first goal is to test whether EMDR therapy + exposure therapy results in less return of fear (panic related symptoms, generalized anxiety), compared to supportive counseling + exposure therapy from posttreatment (T3) to follow up (FU1 and FU2). The second goal is to unravel predictors of optimal treatment allocation (EMDR therapy + exposure therapy > supportive counseling + exposure therapy). These include theory-driven variables (reduced extinction learning, less experienced life events, low intolerance of uncertainty, anxiety sensitivity, low worrying, enhanced imagery ability), patient variables (e.g., greater treatment credibility, better working alliance) and therapist factors (e.g., enhanced trait anxiety, better working alliance, greater treatment expectancy). The third goal is to elucidate mechanisms of change (most notably mental threat imagery, encapsulated threat beliefs) of this novel approach (EMDR therapy + exposure therapy). Finally, we will assess cost-effectiveness of the new approach (EMDR therapy + exposure therapy).
Study design and general procedure
A multicenter, single blind, randomized controlled trial with a two-arm mixed factorial design is used with two groups (EMDR therapy + exposure therapy, supportive counseling + exposure therapy) and three time points (T1: baseline; T2: between-treatments and; T3: posttreatment). The design is presented in Fig. 1 and a flowchart is presented in Fig. 2.
After baseline measurements (T1), participants will be randomly allocated to one of two conditions: (1) four weekly EMDR therapy sessions followed by eight exposure therapy sessions or (2) four weekly supportive counseling sessions followed by eight exposure therapy sessions. Total study duration is 16 weeks (week 1: baseline measurement T1, week 2: case conceptualization, week 3–6: treatment phase 1; EMDR therapy or supportive counseling, week 7: between-treatments measurement T2, week 8–15: treatment phase 2; exposure therapy, week 16: post-treatment measurement T3). Follow up 1 measurement (FU1) and follow up 2 measurement (FU2) will be conducted one month and six months post-treatment measurement (T3). At FU1, the clinician and participant will determine whether additional treatment is needed. Measurement are conducted by a research assistant blind to treatment allocation. The research protocol has been approved by the Medical Ethical Committee of University Medical Center Utrecht (NL NL73918.041).
Participants will be recruited at two specialized treatment centers in the Netherlands: Mondriaan/PsyQ Academic Anxiety Center and Altrecht Academic Anxiety center. Clinicians refer patients who potentially meet inclusion criteria after a standard intake procedure. Potential participants are invited for an information session with the research assistant, who examines inclusion and exclusion criteria. After providing informed consent, baseline assessments (T1) will be made. Afterwards, participants are randomized to one of conditions (EMDR therapy + exposure therapy or supportive counseling + exposure therapy). Inclusion will continue until 50 panic disorder patients completed posttreatment (T3).
Patients will be eligible to participate in the study if they meet the following criteria: (1) at least 18 years of age; (2) sufficient mastery of Dutch language and able to complete questionnaires and understand informed consent information; (3) meet DSM-5 criteria for (primary) panic disorder (with or without agoraphobia); (4) stable medication for at least six weeks and willingness to keep medication stable during the study period (until FU1); and (5) self-reported ability to refrain from alcohol or drugs 24 h before and after each session. General use of alcohol or drugs will be discouraged. Use of sedating medication (e.g., benzodiazepines) is not a contra-indication, but participants are discouraged to use sedating medication before or after treatment sessions and subsequent days. Use of sedating medication will be registered. Patients will not be eligible if they meet any of the following exclusion criteria: (1) self-reported neurological disorder; (2) acute or recent history of suicide attempts according to the Mini-International Neuropsychiatric Interview (M.I.N.I.) section C; (3) self-reported visual or auditory impairments that could hinder treatment; (4) self-reported epilepsy, pregnancy, or heart disease (only for fear-conditioning task); (5) self-reported current psychological treatment for other DSM-5 disorder; and (6) not willing or able to fill in (online) questionnaires.
After baseline measures (T1) participants are randomized to one of the two conditions by a research assistant who does not conduct assessments, using computerized randomization (REDCAP) [53, 54]. Stratified randomization will be used to reduce bias by treatment center , to guarantee a balanced distribution of participants across conditions.
For the primary objectives of efficacy, tolerability, and adherence, the sample size was calculated using G*power 3.1  using a 2 (groups) × 2 (time) repeated-measures ANOVA. Given the active control condition, we expect a medium effect size . For a between group effect size of f = 0.25, alpha 0.05, power 0.80, 0.5 correlation among repeated measures and 1.0 non-sphericity correction, a total sample size of 98 participants is needed for two-sided testing. Although no formal method is available to determine a repeated-measures ANOVA sample size using Bayesian statistics, approximations for t-test are available . For a one-sided t-test with a power of 0.80 and a Bayes factor of 3 (indicating evidence for the data coming from the alternative than the null hypothesis), 87 participants are needed and for a Bayes factor of 5, 99 participants are needed. Originally, we aimed to recruit 100 participants (see pre-registration: ISRCTN - ISRCTN29668369). However, the COVID-19 pandemic has seriously impacted the number of referrals of patients with panic disorder. To increase the feasibility of the study, we formulated directional hypotheses and decided to use one-sided testing, which reduces our sample size to 50 participants . This change was approved by the ethical committee on February 8 2023. Participants who will not show up to therapy sessions in the first two weeks of treatment will be considered non-compliant and will be described as dropouts. Dropouts will not be excluded from intent to treat analyses, but will be replaced by additional participants to preserve statistical power. The completer sample size will be sufficient to address secondary objectives.
Two standardized treatments with an equal duration will be used before (standardized) exposure therapy: EMDR therapy and supportive counseling. Sessions will be provided face-to-face or if that is not possible by video conferencing.
This study uses the Dutch EMDR 2021 protocol (Dutch translation of Shapiro’s standard EMDR protocol) [41, 59]. Our case conceptualization strategy will be based upon the central question as to what flashforward drives the patient’s panic disorder. First, the patient’s flashforward will be assessed (i.e., the mental picture that displays the most terrible outcome of a panic attack) and if this is not available to the patient, the patients is helped to create such a flashforward. Second, memories that may have contributed to the onset or persistence of the disorder will be ordered hierarchically based on subjective units of disturbance (SUD) scores. For the processing of patients’ flashforwards with EMDR therapy, the Flashforward procedure will be used . During EMDR sessions, therapists aim to tax working memory maximally. That is, rather than just making eye movements, the therapist induces fast eye movements, tapping, calculations, backward spelling etc. [42,43,44], an approach that is termed EMDR 2.0 . Multiple targets might be desensitized per session depending on the velocity of SUD decrease. If online treatment is required, a secure online EMDR therapy application (Digital_EMDRapp) will be used as a working memory task . In the app, different reaction time tasks with visual (ball) and auditory (sound) stimuli can be manipulated (pattern, color and speed) and administered by the clinician. This program will be made available free of charge for this project by the company MOOVD.
Supportive counseling is a non-directive psychotherapeutic procedure that focuses on discussing topics that are relevant to the patient in daily life (e.g., family, daily activities, work). The clinician offers support by attentive listening. A protocol was developed based on the protocols used by Bryant and colleagues (1998)  and Boelen and colleagues (2007) , to match session duration in the EMDR therapy condition and other non-specific treatment effects, such as therapeutic alliance, time and contact with a therapist . In earlier randomized controlled trials, supportive counseling slightly lowered anxiety symptoms in patients , so it has been used as a credible active control intervention. During the supportive counseling case-conceptualization session, threat-related imagery will be assessed the same way as in the EMDR therapy condition, so treatment effects can be attributed to the interventions, instead of the case formulation . Next, a supportive counseling case conceptualization will be made, by making an inventory of potential topics the patient wants to discuss. During the sessions, the patient will be free to change the subject to “whatever topic that’s on their mind” [50, 62]. In supportive counseling, clinicians take an emphatical stance and offer support by using the following steps. (1) Ask an open question: “What do you want to discuss right now?”, (2) deepen the conversation by active listening and open questions, (3) paraphrase and reflect during the conversation, (4) summarize the conversation at the end of the conversation, (5) compliment the patient for the hard work, (6) and end the conversation. In order to study working mechanisms, clinicians are explicitly instructed not to focus on specific CBT procedures (i.e., cognitive restructuring, emotional processing of adverse life events, or behavioral exposure) .
During exposure therapy, the patient is systematically and repeatedly confronted with feared but safe stimuli (e.g., interoceptive cues, objects, situations), with the goal that the patient learns that the anticipated feared outcome does not occur (e.g., getting a heart attack) . Exposure therapy will focus on maximizing threat expectancy violation . For panic disorder, the protocol will be based on the Dutch protocol by Kampman, Keijsers and Hendriks (2017) . It involves psycho-education, interoceptive exposure (e.g., with CO2 or physical exercises) and exposure in vivo . To maximize expectancy violation, cognitive techniques prior to exposure are not used, as recommended by Craske and colleagues .
Therapists and training
Therapists participating in the trial will be psychologists, psychotherapists or psychiatric nurse specialists (master degree, advanced mental health qualifications) and have all completed at least a CBT basic course (accredited by the Dutch CBT association) and an EMDR basic course (accredited by the Dutch EMDR association). Therapists are employed in specialized anxiety disorders clinics (Altrecht and Mondriaan). For this study, clinicians will receive four hours of training in exposure techniques (focusing om maximizing threat-expectancy violation), four hours of training in EMDR (focusing on case conceptualization in anxiety disorders and maximizing working memory taxation) and four hours of training in supportive counseling (focusing on non-directive support) by experts in the field. To reduce bias, all therapists will be trained and will participate in all three interventions. To reduce expectancy bias, clinicians will be given the following rationale “EMDR therapy and supportive counseling are both new innovative interventions for panic disorder based on the latest research, but with a different focus. Instead of searching for the best therapy on group level, we will use the latest statistical analysis to unravel what works for whom on an individual level using clinical profiles”. Treatment expectancy of therapists will be assessed. To obtain high treatment quality and to check whether the training was sufficient, supervisors will check case-conceptualizations, session reports, and session recordings.
Supervision and fidelity checks
Case conceptualizations and session reports will be checked after each session and feedback will be provided by experts in the field (EMDR therapy: AdJ, SM; supportive counseling: PD, BE; exposure therapy: AvM, KdC). Supervisors of exposure therapy are blind to the patient’s condition. Clinicians are instructed to report deviations from the protocol. To further improve treatment integrity, online group supervision sessions are provided for all treatments two to four times a year. Treatment sessions will be recorded on audio (supportive counseling and exposure therapy sessions) or video (EMDR therapy sessions and the behavioral avoidance tasks), unless patients do not give permission for this. An independent rater will assess a selection of the video and audiotapes to assess treatment fidelity.
Early completion is defined as: (1) a score of 0 on weekly assessment scores (General Anxiety Disorder (GAD 7) and Panic Disorder Severity Scale (PDSS-SR) (2) in case of EMDR therapy, a SUD of 0 for all targets part of the case conceptualization (3) and no avoidance on the behavioral avoidance task.
Goal 1: investigate whether EMDR therapy + exposure therapy vs supportive counseling + exposure therapy improves treatment efficacy, tolerability, and adherence
The primary and secondary measures to examine goal 1 are presented in Table 1.
Demographics and study eligibility
Eight demographic variables will be assessed: age, sex, cultural background, educational level, native language, marital status, familiarity with the treatments and age of panic disorder onset.
Mini-International Neuropsychiatric Interview-Simplified for DSM-5 (MINI-S-DSM-5):
To assess panic disorder and other diagnoses, the Dutch translation  of the MINI-S- interview [68, 69] version 1.1 (adapted to DSM-5) is administered by an independent psychologist.
Primary outcome variables: efficacy
Panic Disorder Severity Scale- self-report form (PDSS-SR):
The PDSS-SR [70,71,72] is a 7-item questionnaire to assess the severity of panic disorder. Patients rate the frequency, severity and interference of panic attacks in the last week on a 5-point Likert scale (0 = no interference, 5 = extreme interference).
Panic Agoraphobia Scale (PAS):
The PAS  is a 14-item interview to assess panic disorder severity. The severity of panic disorder is rated using a 5-point Likert scale (0 = not at all, 4 = severe) for each item. As a minor addition the frequency of panic attacks as well as the number of avoided places is registered.
Subtle Avoidance Frequency Examination – agoraphobia (SAFE-A):
The SAFE-A is a 40-item questionnaire to assess the frequency of subtle avoidance behavior in agoraphobia [74, 75], using a 5-point Likert scale (0 = never, 5 = always) and when safety behavior is performed on a 3-point Likert scale (1 = before the situation, 2 = during the situation, 3 = during a panic attack).
Fear Questionnaire-Agoraphobia (FQ-A):
The FQ-5 [76, 77] is a 5-item questionnaire to assess avoidance behavior for various places (e.g. busy shop, public transport), using a 9-point Likert scale (0 = I never avoid this, 8 = I always avoid this).
Bodily Sensation Questionnaire (BSQ):
The BSQ  is a 17-item questionnaire to assess fear of bodily sensations in panic disorder, using a 5-point Likert scale (1 = not afraid, 5 = extremely afraid).
Secondary outcome variables: Tolerability of exposure therapy
Willingness to start exposure therapy:
Willingness to start exposure therapy will be assessed with one item developed for this study using a Visual Analogue Scale (VAS) (0 = not willing to do all exposure exercises, 100 = willing to do all exposure exercises).
Intention to stop treatment:
Intention to stop treatment will, retrospectively after treatment, be assessed with one item developed for this study, using a VAS (0 = not at all, 100 = very much).
Behavioral avoidance task:
Behavioral avoidance will be assessed with a standardized task during the first and last exposure therapy session, in which the patient is exposed to self-induced bodily sensations (e.g., self-induced dizziness, accelerated heart rate and hyperventilation or physical exercises) . Clinicians rate the level of avoidance on a standardized scale (developed for this study) based on the number of tasks completed and task difficulty. Afterwards, videotapes will be rated with the same scale by blind assessors.
Secondary outcome variables: Related symptomatology and functional impairment
General Anxiety Disorder 7 (GAD-7):
The GAD-7 [80, 81] is a 7-item questionnaire to measure the frequency of anxiety symptoms on a 4-point Likert scale (0 = not at all, 3 = almost every day) for the past week.
Patient Health Questionnaire (PHQ-9):
The PHQ-9 [81,82,83] is a 9-item questionnaire measuring the frequency of depression symptoms on a 4-point Likert scale (0 = not at all, 3 = almost every day) for the past week.
Work and Social Adjustment Scale (WSAS):
The WSAS [84, 85] is a 5-item self-report questionnaire to assess disability in daily life (e.g., work, home management, social activities) on a 9-point Likert scale (0 = no disability, 8 = severe disability).
Secondary outcome variables: Treatment satisfaction
Client Satisfaction Questionnaire (CSQ-8):
The CSQ-8 [86,87,88] is an 8-item self-report questionnaire to assess treatment satisfaction on a 4-point Likert scale (1 = totally disagree, 4 = totally agree).
Net Promoter Score (NPS):
Patients are asked to give an overall grade for the treatment , on an 11-point Likert scale (0 = very bad treatment; 10 = very good treatment).
Instruments goal 2: unravel theory-driven variables (e.g., traits and clinical profiles) and non-specific patient and therapist factors predicting treatment outcome and optimal treatment allocation
Table 2 presents additional measures to examine secondary goals.
Patient predictors, mediators and moderators
Survey of Autobiographical Memory (SAM)>:
The SAM  is a self-report inventory designed to assess naturalistic episodic autobiographical, semantic and spatial memory, as well as prospection or future thinking using a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). We include the episodic and future thinking subscales only (14 items).
Impact of past event scale (IES):
The IES [91, 92] is a 15-item questionnaire to assess the frequency and avoidance of intrusive mental imagery of past events in the last week, using a 5 point Likert scale (1 = not at all, 5 = extremely).
Impact of future event scale (IFES):
The IFES  is a 24-item questionnaire to assess the frequency and avoidance of intrusive mental imagery for future events in the past week, using a 5 point Likert scale (0 = not at all, 4 = very strong). We administer the intrusion and avoidance subscales (15 items).
List of Threatening Events (LTE):
The LTE  is a 12-item questionnaire to assess experienced life events, participants indicate if the life event occurred (yes/no).
Dutch credibility and expectancy questionnaire (CEQ):
The CEQ  is a 6-item questionnaire to assess treatment credibility and treatment expectancy. Patients rate treatment credibility and -expectancy on a 9 point Likert scale (1 = not at all, 9 = totally). Expected levels of improvement are rated on a 0–100 VAS (0 = no expected improvement, 100 = totally recovered).
Working Alliance Inventory (WAI-12):
The WAI-12 [95, 96] is a 12-item questionnaire to assess working alliance, rated on a 5-point Likert Scale (1 = (almost) never, 5 = always).
Intolerance of Uncertainty Scale (IUS):
The IUS [97, 98] is a 12-item questionnaire to assess intolerance of uncertainty, using a 5-point Likert scale (1 = not at all, 5 = totally).
Anxiety Sensitivity Index (ASI):
The ASI [99, 100] is an 18-item questionnaire to assess anxiety sensitivity using a 5-point Likert scale (1 = (almost) never, 5 = always).
Penn State Worry Questionnaire (PSWQ):
The PSWQ [101, 102] is a 16-item questionnaire to assess worrying, using a 5-point Likert scale (1 = not characteristic at all, 5 = very characteristic).
De novo fear conditioning task:
Individual differences in fear extinction will be assessed with a differential fear conditioning computer task, including four phases: 1) habituation; 2) acquisition; using a scream as aversive stimulus ; 3) extinction; 4) generalization of extinction. Patients will be asked to rate their distress (phases 1–4) and scream expectancy (phases 2–4) [103,104,105]. More information on this task can be found in a pre-registration validating this task in a non-clinical sample (https://osf.io/axwyd).
Clinician: predictors, mediators and moderators
Demographics and expertise:
Based on earlier studies [106, 107], we will assess age, gender, years of expertise, main profession, clinical orientation, and memberships of professional associations. Clinicians rate their own perceived skills compared to other clinicians on two 0–100 VASs (0 = poorest, 100 = the best).
Attitudes Toward Psychotherapy Treatment Manuals (ATPTM):
The ATPTM  is a 19-item questionnaire to assess clinician's attitudes towards psychotherapy treatment manuals, using a 5-point Likert scale (0 = strongly disagree, 4 = strongly agree).
Evidence-Based Practice Attitude Scale (EBPAS:
The EBPAS  is a 15-item questionnaire to assess clinician's attitudes towards evidence-based practice, using a 5-point Likert scale (0 = strongly disagree, 4 = strongly agree).
Credibility Scale (CS):
The CS  is a 5-item questionnaire to assess to what extent clinicians perceive the intervention as credible, using a 7-point Likert scale (1 = not at all, 7 = extremely).
Predicting Treatment Outcome Survey (PTOS):
The PTOS is a self-developed 9-item questionnaire to assess to what extent clinicians predict treatment outcome and whether treatment is suitable for a patient, based on a questionnaire developed by Van Minnen and colleagues .
Working Alliance Inventory (WAI-12):
The WAI-12 [95, 96] is a 12-item questionnaire to assess working alliance, rated on a 5-point Likert Scale (1 = (almost) never, 5 = always).
A 2-item self-developed clinician-administered questionnaire will be used to assess if optimal exposure was hindered using a 7-point Likert scale (1 = not hindered, 7 = severely hindered) and reasons why optimal exposure could not take place (e.g. COVID-19 measures, avoidance, illness, too difficult, other).
Instruments goal 3: elucidate mechanisms of change of this novel approach (EMDR therapy + exposure therapy)
Imagery interview and questionnaire:
The imagery interview is used to assess mental imagery related to panic disorder during the case conceptualization session and the between treatments measurement (T2). It is structured and combines sections of the Waterloo Images and Memories Interview (WIMI) , the imagery interview by Boterhoven de Haan and colleagues  and the Memory Characteristics Questionnaire . First, patients will be asked to choose which disorder-related memory and flashforward is most distressing. Next, they will be asked to describe the flashforward and memory, in as much detail as possible and rate the images’ qualities on several dimensions, such as vividness, sensory quality, complexity etc. using a 7-point Likert scale. Finally, credibility of the encapsulated belief statement that the mental image depicts is rated using a VAS scale (0 = not at all, 100 = extremely).
Instruments goal 4: assess cost-effectiveness of the new approach (EMDR therapy + exposure therapy)
Quality of life and cost-effectiveness
The EQ-5D  is a widely used 5-item questionnaire to assess quality of life. Impairment on several factors (e.g., mobility, self-care, daily activities) is measured on a 5-point Likert scale (1 = no impairment, 5 = extreme impairment). Patients also rate their current health on a thermometer ranging from 0 (worst health imaginable) to 100 (best health imaginable).
Additional treatment: Treatment Inventory of Costs (TIC-P):
The TIC-P  is an 84-item questionnaire to assess medical consumption (16 items), productivity losses (11 items), and chronic diseases (2).
The EQ-5D will be assessed during baseline (T1), between-treatments (T2), post-treatments (T3) and follow-up measures (FU1, FU2) and the TIC-P will be assessed at baseline (T1) and follow-up measures (FU1, FU2).
Data of all randomized participants will be analyzed on intent-to-treat basis as well as the completer sample. The primary outcomes (panic disorder symptomology) as well as secondary outcomes (tolerability and adherence) will be analyzed using a mixed regression model, using baseline scores as a covariate. This enables us to identify any fixed or random effects resulting from the treatments and changes over time. To analyze count date (e.g., drop-out, no show), Poisson or negative binomial regression will be used. Data analysis strategies for the secondary goals (goals 2–4) will be pre-registered in prior to analysis in Open Science Framework .
We present a study protocol for the multicenter IMPROVE randomized controlled trial, examining whether EMDR therapy + exposure therapy vs. supportive counselling + exposure therapy improves treatment efficacy, tolerability, and adherence in patients with panic disorder. To our knowledge, this is the first study that specifically focusses on desensitizing future as well as past oriented threat-imagery, prior to exposure therapy. Furthermore, this randomized controlled trial will focus on theory-driven as well as non-specific patient and therapist factors predicting treatment outcome and optimal treatment allocation. By focusing on hypothesized underlying mechanisms of change and the long term effects of treatment we will broaden our understanding of treatment processes, potentially paving the way towards the era of personalized treatment. Lastly, cost-effectiveness of the new approach (EMDR therapy + exposure therapy) will be assessed when proven effective.
The study design has several strengths. First, a parsimonious principle was used in the development of the intervention by taking a mechanistic approach . Instead of developing a new treatment, we aim to improve the best available treatment. As suggested by Clark , our research started with phenomenological observations [21, 22] followed by years of experimental research in our lab exploring the mechanisms involved [26, 46, 47], so our intervention is strongly grounded in theory as well as experimental research [42,43,44]. As a next step, we will now test the intervention in practice. Hereby, identifying predictors, mediators and moderators of treatment that could help us develop new theoretical models and aid diagnostic- and treatment decision-making [64, 116], paving the way into the era of personalized medicine .
Secondly, we expect to recruit a culturally and socioeconomically diverse sample. No strict exclusion criteria are used and clinics are in large cities across the Netherlands, which enhances the external validity of our results [119, 120]. Given that dropouts are common in this population [11,12,13,14], we will use an intention to treat analysis. Reasons for dropout will be monitored as attrition rates are an important outcome measure in this study. Validity of the trial is further improved by using standardized measures and by letting the assessments being conducted by researchers blind to treatment condition. Furthermore, the sample size should provide sufficient power for the primary- and secondary aims to enable meaningful conclusions.
Researcher allegiance bias is problematic in psychotherapy research [121, 122], including studies about EMDR therapy efficacy in anxiety disorders [38, 40]. Therefore, we follow recommendations to reduce research allegiance bias, such as having a collaborative team with mixed allegiances . Study therapists are trained and supervised for the same amount of time for all treatment conditions, and treatment integrity will be checked . To reduce expectancy biases in patients and clinicians a strong rational for all treatments, including supportive counselling, is provided. Furthermore, we use identical procedures (including EMDR-case conceptualization) and treatment duration between conditions. Treatment credibility and expectancy for all treatments are monitored for all patients and study-therapists.
No waiting list control group is used, which could be considered a limitation [124, 125], given that it can serve as a valuable benchmark in pilot studies for a new intervention , but it is not necessary in this study for at least four reasons. First, effect sizes for EMDR therapy, supportive counseling and CBT in anxiety disorders have already been established [9, 38, 40], so a benchmark is not needed and could artificially inflate effect sizes [126, 127]. Second, it could also result in unwanted nocebo effects [125, 128, 129]. Third, it can create ethical dilemmas [125, 130] and potentially raise the threshold to participate in a trial resulting in selection bias [127, 131]. Finally, it can reduce study or treatment satisfaction [127, 132] which may influence attrition rates .
Furthermore, no direct comparison between EMDR therapy and exposure therapy is made . However, instead of finding a substitute for exposure, we aim to improve it beyond common factors by studying mechanisms of action. So, the question whether EMDR therapy is more effective compared to exposure therapy is beyond the scope of this study.
Although knowledge of the long-term effects of CBT is urgently needed [16, 18] only a six month instead of a one- or two-year follow-up measurement is included. After follow-up 1 (FU1; one-month posttreatment) patients will receive additional treatment if needed (also for co-morbid disorders), as we aim to include a representative sample. Therefore, long-term effects can not solely be attributed to the trial interventions. We could not circumvent this issue due to ethical considerations.
Finally, as this study is an efficacy trial, highly trained and supervised professionals provide the treatment, therefore effectiveness research is still needed after the trial . To promote the dissemination of the results a treatment protocol will be published separately.
To recapitulate, many anxiety patients do not profit sufficiently from CBT, underlining the urgent need for treatment optimization. Threat-related imagery may play a maintaining role in the disorder or impede exposure therapy. Currently, imagery (especially future-oriented) is not targeted in standard CBT for anxiety disorders. Therefore, we aim to assess whether EMDR therapy with exposure therapy, relative to supportive counseling with exposure therapy, improves treatment efficacy, tolerability, and adherence in patients with panic disorder. The results of this study may have important clinical implications for the treatment of patients with anxiety disorders, as well as a better understanding of the mechanisms of action paving the way to personalized medicine.
Currently recruiting participants.
Version 1: original, issue date 26–08-2020. Version 2: amendment adding treatment integrity (video recordings), issue date 26–05-2021. Version 3: amendment changing information letter and adding time stamps in questionnaire response, issue date 27–07-2021. Version 4: amendment to 1) reduce the sample size for panic disorder from N = 100 to N= 50 to enhance feasibility of the study and adapting statistical analyses accordingly (one-sides testing instead of two sided testing), 2) terminate a RCT in social anxiety disorder, due to a low influx of participants, 3) the option for participants not to consent with audio and video recordings, 4) change the session frequency (once instead of twice weekly), 5) stopping the Experience Sampling Measurements, 6) enable videoconferencing aside from the pandemic restrictions, 7) report the study progress, issue date 08-02-2023.
Availability of data and materials
To promote open science, this trial is retrospectively registered ISRCTN—ISRCTN29668369: Improving anxiety treatment by modifying emotional memories before real-life exposure including the (main) hypotheses. Materials (in Dutch) used in the study as well as all the articles that are a product of this trial will be made available after trial completion in the trial registry. The World Health Organization trial registration data set guidelines (SPIRIT guidelines) will be used to register the data set [134, 135]. To promote data quality, a secured data base (REDCAP) will be used [53, 54]. For further details about data storage and security, see the original IRB-proposal. Data sharing for this study is not applicable yet, because no datasets have so far been generated or analyzed.
Anxiety Sensitivity Index
Attitudes Toward Psychotherapy Treatment Manuals
Bodily Sensation Questionnaire
Cognitive behavioral therapy
Dutch credibility and expectancy scale
Client Satisfaction Questionnaire
Evidence-Based Practice Attitude Scale
Eye movement desensitization and reprocessing
General Anxiety Disorder 7
Impact of past event scale
Impact of future event scale
Intolerance of Uncertainty Scale
Linear Mixed Models
List of Threatening Events
Mini-International Neuropsychiatric Interview-Simplified for DSM-5
Mixed Logistic Regression
Net Promotor Score
Panic Agoraphobia Scale
Panic Disorder Severity Scale- self-report form
Pen State Worry Questionnaire
Predicting Treatment Outcome Survey
Research Electronic Data Capture
Subtle Avoidance Frequency Examination – agoraphobia
Survey of Autobiographical Memory
Subjective unit of distress
Treatment Inventory of Costs
Visual Analogue Scales
Validity of cognition
Working Alliance Inventory
Waterloo Images and Memories Interview
Work and Social Adjustment Scale
Baxter AJ, Scott KM, Vos T, Whiteford HA. Global prevalence of anxiety disorders: a systematic review and meta-regression. Psychol Med. 2013;43(5):897–910. https://doi.org/10.1017/S003329171200147X.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. text revision. American Psychiatric Association Publishing; 2022. Section 2, Anxiety disorders [Cited 2022 Nov 1]. Avalable from: https://doi-org.proxy.library.uu.nl/10.1176/appi.b.
Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012;380(9859):2163–96. https://doi.org/10.1016/s0140-6736(12)61729-2.
Gustavsson A, Svensson M, Jacobi F, Allgulander C, Alonso J, Beghi E, et al. Cost of disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. 2011;21(10):718–79. https://doi.org/10.1016/j.euroneuro.2011.08.008.
Greenberg PE, Sisitsky T, Kessler RC, Finkelstein SN, Berndt ER, Davidson JR, et al. The economic burden of anxiety disorders in the 1990s. J Clin Psychiatry. 1999;60(7):427–35. https://doi.org/10.4088/JCP.v60n0702.
Andrews G, Bell C, Boyce P, Gale C, Lampe L, Marwat O, et al. Royal Australian and New Zealand College of Psychiatrists clinical practice guidelines for the treatment of panic disorder, social anxiety disorder and generalised anxiety disorder. Aust N Z J Psychiatry. 2018;52(12):1109–72. https://doi.org/10.1177/0004867418799453.
National Institute for Health and Clinical Excellence. Common mental health problems: identification and pathways to care. 2011 [cited 2022 Oct 9]. Available from: https://www.nice.org.uk/guidance/cg123.
Craske M, Treanor M, Zbozinek T, Vervliet B. Optimizing exposure therapy with an inhibitory retrieval approach and the OptEx Nexus. Behav Res Ther. 2022;152:104069.
Carpenter JK, Andrews LA, Witcraft SM, Powers MB, Smits JAJ, Hofmann SG. Cognitive behavioral therapy for anxiety and related disorders: A meta-analysis of randomized placebo-controlled trials. Depress Anxiety. 2018;35(6):502–14. https://doi.org/10.1002/da.22728.
Parker Z, Waller G, Dugne PGZ, Dawon J. The role of exposure treatment in anxiety disorders: a meta-analysis. Int J Psychol Psychol. 2018;18(1):111–41.
Garcia-Palacios A, Botella C, Hoffman H, Fabregat S. Comparing acceptance and refusal rates of virtual reality exposure vs. in vivo exposure by patients with specific phobias. Cyberpsychol Behav. 2007;10(5):722–4. https://doi.org/10.1089/cpb.2007.9962.
Issakidis C, Andrews G. Pretreatment attrition and dropout in an outpatient clinic for anxiety disorders. Acta Psychiatr Scand. 2004;109(6):426–33. https://doi.org/10.1111/j.1600-0047.2004.00264.x.
White K, Allen L, Barlow D, Gorman J, Shear M, Woods SW. Attrition in a multicenter clinical trial for panic disorder. J Nerv Ment Dis. 2010;198(9):665–71.
Bentley KH, Cohen ZD, Kim T, Bullis JR, Nauphal M, Cassiello-Robbins C, et al. The nature, timing, and symptom trajectories of dropout from transdiagnostic and single-diagnosis cognitive-behavioral therapy for anxiety disorders. Behav Ther. 2021. https://doi.org/10.1016/j.beth.2021.03.007.
Loerinc AG, Meuret AE, Twohig MP, Rosenfield D, Bluett EJ, Craske MG. Response rates for CBT for anxiety disorders: Need for standardized criteria. Clin Psychol Rev. 2015;42:72–82. https://doi.org/10.1016/j.cpr.2015.08.004.
van Dis EAM, van Veen SC, Hagenaars MA, Batelaan NM, Bockting CLH, van den Heuvel RM, et al. Long-term outcomes of cognitive behavioral therapy for anxiety-related disorders: a systematic review and meta-analysis. JAMA Psychiatry. 2020;77(3):265–73. https://doi.org/10.1001/jamapsychiatry.2019.3986.
Levy HC, O’Bryan EM, Tolin DF. A meta-analysis of relapse rates in cognitive-behavioral therapy for anxiety disorders. J Anxiety Disord. 2021;81:1–8. https://doi.org/10.1016/j.janxdis.2021.102407.
Lorimer B, Kellett S, Nye A, Delgadillo J. Predictors of relapse and recurrence following cognitive behavioural therapy for anxiety-related disorders: a systematic review. Cogn Behav Ther. 2021;50(1):1–18. https://doi.org/10.1080/16506073.2020.1812709.
Vervliet B, Craske MG, Hermans D. Fear extinction and relapse: state of the art. Annu Rev Clin Psychol. 2013;9:215–48. https://doi.org/10.1146/annurev-clinpsy-050212-185542.
Davey GCL. A conditioning model of phobias. In: Davey GCL, editor. Phobias—A handbook of theory, research and treatment: Wiley; 1997. p. 301–22.
Hackmann A, Holmes EA. Reflecting on imagery: a clinical perspective and overview of the special issue of memory on mental imagery and memory in psychopathology. Memory. 2004;12(4):389–402. https://doi.org/10.1080/09658210444000133.
Holmes EA, Mathews A. Mental imagery in emotion and emotional disorders. Clin Psychol Rev. 2010;30(3):349–62. https://doi.org/10.1016/j.cpr.2010.01.001.
Çili S, Stopa L. Intrusive mental imagery in psychological disorders: Is the self the key to understanding maintenance? Front Psychiatry. 2015;6:103. https://doi.org/10.3389/fpsyt.2015.00103.
Saulsman LM, Ji JL, McEvoy PM. The essential role of mental imagery in cognitive behaviour therapy: what is old is new again. Aust Psychol. 2019 [cited 2023 Jan 4];54(4):237–44. Available from: https://onlinelibrary-wiley-com.proxy.library.uu.nl/doi/full/10.1111/ap.12406.
Deeprose C, Holmes EA. An exploration of prospective imagery: the impact of future events scale. Behav Cogn Psychother. 2010;38(2):201–9. https://doi.org/10.1017/S1352465809990671.
Engelhard IM, van den Hout MA, Janssen WC, van der Beek J. Eye movements reduce vividness and emotionality of “ flashforwards.” Behav Res Ther. 2010;48(5):442–7.
Holmes EA, Mathews A. Mental imagery and emotion: a special relationship? Emotion. 2005;5(4):489–97.
Krypotos A-M, Mertens G, Leer A, Engelhard IM. Induction of conditioned avoidance via mental imagery. Behav Res Ther. 2020;132:103652.
Ji J, Heyes S, MacLeod C, Holmes E. Emotional mental imagery as simulation of reality: fear and beyond—a tribute to Peter Lang. Behav Ther. 2016;47(5):702–19.
Mertens G, Krypotos AM, Engelhard IM. A review on mental imagery in fear conditioning research 100 years since the ‘Little Albert’ study. Behav Res Ther. 2020 [cited 2022 Oct 17];126. Available from: https://pubmed.ncbi.nlm.nih.gov/32014694/.
Leer A, Engelhard IM, Altink A, van den Hout MA. Eye movements during recall of aversive memory decreases conditioned fear. Behav Res Ther. 2013;51(10):633–40. https://doi.org/10.1016/j.brat.2013.07.004.
Dibbets P, Poort H, Arntz A. Adding imagery rescripting during extinction leads to less ABA renewal. J Behav Ther Exp Psychiatry. 2012;43(1):614–24. https://doi.org/10.1016/j.jbtep.2011.08.006.
Landkroon E, van Dis EAM, Meyerbröker K, Salemink E, Hagenaars MA, Engelhard IM. Future-oriented positive mental imagery reduces anxiety for exposure to public speaking. Behav Ther. 2021. https://doi.org/10.1016/j.beth.2021.06.005.
Nilsson J-E, Knutsson J, Jalamo B-S, Lundh L-G. Imagery rescripting of early memories in health anxiety disorder: a feasibility and non-randomized pilot study. J Behav Ther Exp Psychiatry. 2019;65:101491. https://doi.org/10.1016/j.jbtep.2019.101491.
Strachan LP, Hyett MP, McEvoy PM. Imagery rescripting for anxiety disorders and obsessive-compulsive disorder: recent advances and future directions. Curr Psychiatry Rep. 2020;22(4):1–8. https://doi.org/10.1007/s11920-020-1139-4.
Wild J, Clark DM. Imagery rescripting of early traumatic memories in social phobia. Cogn Behav Pract. 2011;18(4):433–43. https://doi.org/10.1016/j.cbpra.2011.03.002.
Morina N, Lancee J, Arntz A. Imagery rescripting as a clinical intervention for aversive memories: a meta-analysis. J Behav Ther Exp Psychiatry. 2017;55:6–15.
Cuijpers P, van Veen SC, Sijbrandij M, Yoder W, Cristea IA. Eye movement desensitization and reprocessing for mental health problems: a systematic review and meta-analysis. Cogn Behav Ther. 2020;49(3):165–80. https://doi.org/10.1080/16506073.2019.1703801.
Horst F, Den Oudsten B, Zijlstra W, de Jongh A, Lobbestael J, De Vries J. Cognitive behavioral therapy vs. eye movement desensitization and reprocessing for treating panic disorder a randomized controlled trial. Front Psychol. 2017;8:1409. https://doi.org/10.3389/fpsyg.2017.01409.
Yunitri N, Kao C-C, Chu H, Voss J, Chiu H-L, Liu D, et al. The effectiveness of eye movement desensitization and reprocessing toward anxiety disorder: a meta-analysis of randomized controlled trials. J Psychiatr Res. 2020;123:102–13. https://doi.org/10.1016/j.jpsychires.2020.01.005.
Shapiro F. Efficacy of the eye movement desensitization procedure in the treatment of traumatic memories. J Trauma Stress. 1989;2(2):199–223. https://doi.org/10.1002/jts.2490020207.
Engelhard IM, McNally RJ, van Schie K. Retrieving and modifying traumatic memories: recent research relevant to three controversies. Curr Dir Psychol Sci. 2019;28(1):91–6. https://doi.org/10.1177/0963721418807728.
Landin-Romero R, Moreno-Alcazar A, Pagani M, Amann BL. How does eye movement desensitization and reprocessing therapy work? A systematic review on suggested mechanisms of action. Front Psychol. 2018;9(1395):1–23. https://doi.org/10.3389/fpsyg.2018.01395.
Mertens G, Lund M, Engelhard IM. The effectiveness of dual-task interventions for modulating emotional memories in the laboratory: a meta-analysis. Acta Psychologica. 2021;220:103424. https://doi.org/10.1016/j.actpsy.2021.103424.
Addis DR, Wong AT, Schacter DL. Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia. 2007;45(7):1363–77. https://doi.org/10.1016/j.neuropsychologia.2006.10.016.
Engelhard IM, Sijbrandij M, van den Hout MA, Rutherford NM, Rahim HF, Kocak F. Choking under pressure: Degrading flashforwards related to performance anxiety. J Exp Psychopathol. 2012;3(2):158–67. https://doi.org/10.5127/jep.024111.
Engelhard IM, van den Hout MA, Dek ECP, Giele CL, van der Wielen J-W, Reijnen MJ, et al. Reducing vividness and emotional intensity of recurrent “flashforwards” by taxing working memory: an analogue study. J Anxiety Disord. 2011;25(4):599–603. https://doi.org/10.1016/j.janxdis.2011.01.009.
Logie RDJ, Jongh AD. The “flashforward procedure”: Confronting the catastrophe. J EMDR Pract Res. 2014;8(1):25–32. https://doi.org/10.1891/1933-322.214.171.124.
Blackwell SE. Mental imagery in the science and practice of cognitive behaviour therapy: past, present, and future perspectives. Int J Cogn Ther. 2021 [cited 2023 Jan 4];14(1):160–81. Available from: https://doi.org/10.1007/s41811-021-00102-0.
Bryant RA, Harvey AG, Dang ST, Sackville T, Basten C. Treatment of acute stress disorder: a comparison of cognitive- behavioral therapy and supportive counseling. J Consult Clin Psychol. 1998 [cited 2022 Oct 10];66(5):862–6.
Somers JM, Goldner EM, Waraich P, Hsu L. Prevalence and incidence studies of anxiety disorders: a systematic review of the literature. Can J Psychiatry. 2006;51(2):100–13. https://doi.org/10.1177/070674370605100206.
Foster E, Deardorff A. Open Science Framework (OSF). J Med Library Association. 2017;105:203.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. https://doi.org/10.1016/j.jbi.2019.103208.
Suresh KP. An overview of randomization techniques: An unbiased assessment of outcome in clinical research. J Hum Reprod Sci. 2011;4(1):8–11. https://doi.org/10.4103/0974-1208.82352.
Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149–60. https://doi.org/10.3758/BRM.41.4.1149.
Fu Q, Hoijtink H, Moerbeek M. Sample-size determination for the Bayesian t test and Welch’s test using the approximate adjusted fractional Bayes factor. Behav Res Methods. 2020;53(1):139–52.
Vanbrabant L, Van De Schoot R, Rosseel Y. Constrained statistical inference: sample-size tables for ANOVA and regression. Front Psychol. 2015;5:63. https://doi-org.proxy.library.uu.nl/10.3389/fpsyg.2014.01565.
Shapiro, F. Eye Movement Desensitization and Reprocessing: Basic Principles, Protocols and Procedures, 3rd ed.; Guilford Press: New York, NY, USA, 2018.Vereniging EMDR Nederland. EMDR standaardprotocol 2021. 2021. https://www.emdr.nl/. Accessed September 2021
Matthijssen SJ, Brouwers T, van Roozendaal C, Vuister T, de Jongh A. The effect of EMDR versus EMDR 2.0 on emotionality and vividness of aversive memories in a non-clinical sample. Euro J Psych Traumatol. 2021;12:1956793.
Moovd. Moovd. Nijverdal; Moovd B.v.; 2022 [updated date 2022, cited 2022 June 9]. Available from: https://moovd.nl/methodes/digital-emdr/.
Boelen PA, de Keijser J, van den Hout MA, van den Bout J. Treatment of complicated grief: a comparison between cognitive-behavioral therapy and supportive counseling. J Consult Clin Psychol. 2007;75(2):277–84. https://doi.org/10.1037/0022-006X.75.2.277.
Herbert JD, Gaudiano BA, Rheingold AA, Moitra E, Myers VH, Dalrymple KL, et al. Cognitive behavior therapy for generalized social anxiety disorder in adolescents: a randomized controlled trial. J Anxiety Disord. 2009;23(2):167–77. https://doi.org/10.1016/j.janxdis.2008.06.004.
Cuijpers P, Reijnders M, Huibers MJH. The role of common factors in psychotherapy outcomes. Annu Rev Clin Psychol. 2019;15:207–31. https://doi.org/10.1146/annurev-clinpsy-050718-095424.
Kampman M, Keijsers GPJ, Hendriks GJ. Protocollaire behandeling van patiënten met een paniekstoornis met of zonder comorbide agorafobie: Interoceptieve exposure, cognitieve gedragstherapie en exposure in vivo. In: Keijsers G, van Minnen A, Verbraak M, editors. Protocollaire behandelingen voor volwassenen met psychische klachten klachten deel 1. Amsterdam: Boom; 2017. p. 177–230.
Clark DM. A cognitive model of panic attacks. In: Rachman S, Maser JD, editors. Panic: Psychological perspectives. Lawrence Erlbaum Associates: Inc; 1988. p. 71–89.
Overbeek T, Schruers K. Mini International Neuropsychiatric Interview-Simplified voor DSM-5: Nederlandse vertaling versie 2. 2019.
Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I) the development and validation of a structured diagnostic psychiatric interview for DSM IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33.
Hergueta T, Weiller E. Evaluating depressive symptoms in hypomanic and manic episodes using a structured diagnostic tool: validation of a new Mini International Neuropsychiatric Interview (MINI) module for the DSM-5’With Mixed Features’ specifier. Int J Bipolar Disorders. 2013;1(1):1–10. https://doi.org/10.1186/2194-7511-1-21.
Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Vander Bilt J, et al. Reliability and validity of the Panic Disorder Severity Scale: replication and extension. J Psychiatr Res. 2001;35(5):293–6.
Houck P, Spiegel D, Shear M, Rucci P. Reliability of the self-report version of the panic disorder severity scale. Depress Anxiety. 2002;15(4):183–5.
de Beurs E, den Hollander M, van Rood YR, Zitman F. The Dutch version of the Panic Disorder Severity Scale: Reliability and validity. In: Levin JK, Torterolo AD, editors. Panic Disorder: Symptoms, Treatment and Prevention. Hauppauge: Nova Science; 2011;35(5):293–6.
Bandelow B. Assessing the efficacy of treatments for panic disorder and agoraphobia II. The panic and Agoraphobia scale. Int Clin Psychopharmacol. 1995;10:73–10. https://doi.org/10.1097/00004850-199506000-00003.
Funayama T, Furukawa T, Nakano Y, Noda Y, Ogawa S, Watanabe N, et al. In-situation safety behaviors among patients with panic disorder: descriptive and correlational study. Psychiatry Clin Neurosci. 2013;67(5):332–9.
Aafjes-van Doorn K, Zilcha-Mano S, Graham K, Caldari A, Barber JP, Chambless DL, et al. The role of safety behaviors in panic disorder treatment: Self-regulation or self-defeat? J Contemp Psychother. 2019;49(4):203–12. https://doi.org/10.1007/s10879-019-09432-9.
Van Zuuren FJ. The Fear Questionnaire. Some data on validity, reliability and layout. Br J Psychiatry. 1988 [cited 2023 Feb 6];153(NOV.):659–62. Available from: https://doi.org/10.1192/bjp.153.5.659.
Marks IM, Mathews AM. Brief standard self-rating for phobic patients. Behav Res Ther. 1979;17(3):263–7. https://doi.org/10.1016/0005-7967(79)90041-x.
Chambless DL, Caputo GC, Bright P, Gallagher R. Assessment of fear of fear in agoraphobics: the body sensations questionnaire and the Agoraphobic cognitions questionnaire. J Consult Clin Psychol. 1984;52(6):1090–7. https://doi.org/10.1037//0022-006x.52.6.1090.
Boswell J, Farchione T, Sauer-Zavala S, Murray H, Fortune M, Barlow D. Anxiety sensitivity and interoceptive exposure: a transdiagnostic construct and change strategy. Behav Ther. 2013;44(3):417–31.
Donker T, van Straten A, Marks I, Cuijpers P. Quick and easy self-rating of generalized anxiety disorder: validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 2011;188(1):58–64.
National Collaborating Centre for Mental Health. The Improving Access to Psychological Therapies Manual. 5. In: NHS Digital; 2018 [updated 2021 August; cited 2022 Nov 1]. Available from: https://www.england.nhs.uk/wp-content/uploads/2018/06/the-iapt-manual-v5.pdf.
Löwe B, Spitzer RL, Gräfe K, Kroenke K, Quenter A, Zipfel S, Herzog W. Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians’ diagnoses. J Affect Disord. 2004;78:131–40. https://doi.org/10.1016/s0165-0327(02)00237-9.
Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). J Affect Disord. 2004;81:61–6.
Pedersen G, Kvarstein E, Wilberg T. The work and social adjustment scale: psychometric properties and validity among males and females, and outpatients with and without personality disorders. Personal Ment Health. 2017;11(4):215–28.
Zahra D, Qureshi A, Henley W, Taylor R, Quinn C, Pooler J, et al. The work and social adjustment scale: reliability, sensitivity and value. Int J Psychiatry Clin Pract. 2014;18(2):131–8.
Attkisson C, Zwick R. The client satisfaction questionnaire : Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7.
de Brey H. A cross-national validation of the client satisfaction questionnaire: the Dutch experience. Eval Program Plann. 1983;6(3–4):395–400. https://doi.org/10.1016/0149-7189(83)90018-6.
Nguyen TD, Attkisson CC, Stegner BL. Assessment of patient satisfaction: development and refinement of a Service Evaluation Questionnaire. Eval Program Plann. 1983;6(3–4):299–313.
Nivel. Ontwikkelingen in het meten en gebruiken van patiëntervaringen en patiënt gerapporteerde uitkomsten: van de huidige stand van zaken naar lessen voor de toekomst. In Nivel; 2018 [Updated 2018, cited; 2020, May 29]. Available form: https://www.zorginstituutnederland.nl/publicaties/rapport/2018/07/25/ontwikkelingen-in-het-meten-en-gebruiken-van-patientervaringen-en-patientgerapporteerde-uitkomsten.
Palombo DJ, Williams LJ, Abdi H, Levine B. The survey of autobiographical memory (SAM): a novel measure of trait mnemonics in everyday life. Cortex. 2013;49(6):1526–40. https://doi.org/10.1016/j.cortex.2012.08.023.
Horowitz M, Wilner N, Alvarez W. Impact of event scale: a measure of subjective stress. Psychosom Med. 1979;41(3):209–18. https://doi.org/10.1097/00006842-197905000-00004.
van der Ploeg E, Mooren T, Kleber R, van der Velden P, Brom D. Construct validation of the Dutch version of the impact of event scale. Psychol Assess. 2004;16(1):16–26.
Rosmalen JGM, Bos EH, de Jonge P. Validation of the Long-term Difficulties Inventory (LDI) and the List of Threatening Experiences (LTE) as measures of stress in epidemiological population-based cohort studies. Psychol Med. 2012;42(12):2599–608. https://doi.org/10.1017/S0033291712000608.
Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73–86. https://doi.org/10.1016/s0005-7916(00)00012-4.
Horvath A, Greenberg L. Development and validation of the working alliance inventory. J Couns Psychol. 1989;36(2):223–33.
Stinckens N, Ulburghs A, Claes L. De werkalliantie als sleutelelement in het therapiegebeuren. Meting met behulp van de WAV 12 de Nederlandse vertaling van de working alliance inventory. Tijdschr Klin Psychol. 2009;39:44–60.
Buhr K, Dugas MJ. The intolerance of uncertainty scale: psychometric properties of the English version. Behav Res Ther. 2002;40(8):931–45. https://doi.org/10.1016/s0005-7967(01)00092-4.
Boelen PA, Vrinssen I, Van Tulder F. Intolerance of uncertainty in adolescents: correlations with worry, social anxiety, and depression. J Nerv Ment Dis. 2010 [cited 2023 Jan 23];198(3):194–200. Available from: https://journals.lww.com/jonmd/Fulltext/2010/03000/Intolerance_of_Uncertainty_in_Adolescents_.5.aspx.
Reiss S, Peterson R, Gursky D, McNally R. Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav Res Ther. 1986;24(1):1–8.
Vujanovic AA, Arrindell WA, Bernstein A, Norton PJ, Zvolensky MJ. Sixteen-item anxiety sensitivity index: confirmatory factor analytic evidence, internal consistency, and construct validity in a young adult sample from the Netherlands. Assessment. 2007;14(2):129–43. https://doi.org/10.1177/1073191106295053.
Meyer T, Miller M, Metzger R, Borkovec T. Development and validation of the penn state worry questionnaire. Behav Res Ther. 1990;28(6):487–95.
van der Heiden C, Muris P, Bos AER, van der Molen H, Oostra M. Normative data for the Dutch version of the Penn State Worry questionnaire. Neth J Psychol. 2009;65(2):69–75. https://doi.org/10.1007/BF03080129.
Lonsdorf TB, Merz CJ. More than just noise: Inter-individual differences in fear acquisition, extinction and return of fear in humans - Biological, experiential, temperamental factors, and methodological pitfalls. Neurosci Biobehav Rev. 2017;80:703–28. https://doi.org/10.1016/j.neubiorev.2017.07.007.
Wong AHK, Lovibond PF. Excessive generalisation of conditioned fear in trait anxious individuals under ambiguity. Behav Res Ther. 2018;107:53–63. https://doi.org/10.1016/j.brat.2018.05.012.
Zbozinek TD, Craske MG. Pavlovian extinction of fear with the original conditional stimulus, a generalization stimulus, or multiple generalization stimuli. Behav Res Ther. 2018;107:64–75. https://doi.org/10.1016/j.brat.2018.05.009.
van Minnen A, Hendriks L, Olff M. When do trauma experts choose exposure therapy for PTSD patients? A controlled study of therapist and patient factors. Behav Res Ther. 2010;48(4):312–20. https://doi.org/10.1016/j.brat.2009.12.003.
Parker ZJ, Waller G. Factors related to psychotherapists’ self-assessment when treating anxiety and other disorders. Behav Res Ther. 2015;66:1–7. https://doi.org/10.1016/j.brat.2014.12.010.
Waller G, Mountford V, Tatham M, Turner H, Gabriel C, Webber R. Attitudes towards psychotherapy manuals among clinicians treating eating disorders. Behav Res Ther. 2013;51(12):840–4.
Ashcraft RGP, Foster SL, Lowery AE, Henggeler SW, Chapman JE, Rowland MD. Measuring practitioner attitudes toward evidence-based treatments: a validation study. J Child Adolesc Subst Abuse. 2011;20(2):166–83. https://doi.org/10.1080/1067828X.2011.555276.
Addis ME, Carpenter KM. Why, why, why?: Reason-giving and rumination as predictors of response to activation-and insight-oriented treatment rationales. J Clin Psychol. 1999;55(7):881–94. https://doi.org/10.1002/(sici)1097-4679(199907)55:7%3c881::aid-jclp9%3e3.0.co;2-e.
Moscovitch DA, Gavric DL, Merrifield C, Bielak T, Moscovitch M. Retrieval properties of negative vs positive mental images and autobiographical memories in social anxiety: outcomes with a new measure. Behav Res Ther. 2011;49(8):505–17. https://doi.org/10.1016/j.brat.2011.05.009.
Boterhoven de Haan KL, Lee CW, Fassbinder E, Voncken MJ, Meewisse M, Van Es SM, et al. Imagery rescripting and eye movement desensitisation and reprocessing for treatment of adults with childhood trauma-related post-traumatic stress disorder: IREM study design. BMC Psychiatry. 2017;17(1):1–12. https://doi.org/10.1186/s12888-017-1330-2.
Johnson MK, Foley MA, Suengas AG, Raye CL. Phenomenal characteristics of memories for perceived and imagined autobiographical events. J Exp Psychol Gen. 1988;117(4):371–6. https://doi.org/10.1037/0096-34126.96.36.1991.
Versteegh MM, Vermeulen KM, Evers SM, De Wit GA, Prenger R, Stolk EA. Dutch tariff for the five-level version of EQ-5D. Value Health. 2016;19(4):343–52. https://doi.org/10.1016/j.jval.2016.01.003.
Bouwmans C, De Jong K, Timman R, Zijlstra-Vlasveld M, Van der Feltz-Cornelis C, Tan Swan S, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res. 2013;13:217. https://doi.org/10.1186/1472-6963-13-217.
Holmes EA, Ghaderi A, Harmer CJ, Ramchandani PG, Cuijpers P, Morrison AP, et al. The lancet psychiatry commission on psychological treatments research in tomorrow’s science. Lancet Psychiatry. 2018;5(3):237–86. https://doi.org/10.1016/S2215-0366(17)30513-8.
Clark DM. Developing new treatments: on the interplay between theories, experimental science and clinical innovation. Behav Res Ther. 2004;42(9):1089–104. https://doi.org/10.1016/j.brat.2004.05.002.
Huibers M, Lorenzo-Luaces L, Cuijpers P, Kazantzis N. On the road to personalized psychotherapy: a research agenda based on cognitive behavior therapy for depression. Fron Psychiatry. 2021;11:607508.
Shean G. Limitations of randomized control designs in psychotherapy research. Adv Psychiatry. 2014. https://doi.org/10.1155/2014/561452.
Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J. A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials. 2015;16(495):1–14. https://doi.org/10.1186/s13063-015-1023-4.
Leykin Y, DeRubeis RJ. Allegiance in psychotherapy outcome research: Separating association from bias. Clin Psychol (New York). 2009;16(1):54. https://doi.org/10.1111/j.1468-2850.2009.01143.x.
Munder T, Brütsch O, Leonhart R, Gerger H, Barth J. Researcher allegiance in psychotherapy outcome research: an overview of reviews. Clin Psychol Rev. 2013;33(4):501–11. https://doi.org/10.1016/j.cpr.2013.02.002.
Matthijssen SJMA, Lee CW, de Roos C, Barron IG, Jarero I, Shapiro E, et al. The current status of EMDR therapy, specific target areas, and goals for the future. J EMDR Pract Res. 2020;14(4):241–84. https://doi.org/10.1891/EMDR-D-20-00039.
Steinert C, Stadter K, Stark R, Leichsenring F. The effects of waiting for treatment: a meta-analysis of waitlist control groups in randomized controlled trials for social anxiety disorder. Clin Psychol Psychother. 2016;24(3):649–60.
Patterson B, Boyle M, Kivlenieks M, Van Ameringen M. The use of waitlists as control conditions in anxiety disorders research. J Psychiatr Res. 2016;83:112–20.
Cuijpers P, Cristea IA. How to prove that your therapy is effective, even when it is not: a guideline. Epidemiol Psychiatr Sci. 2015;25(5):428–35. https://doi.org/10.1017/S2045796015000864.
Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, et al. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom. 2009;78(5):275–84. https://doi.org/10.1159/000228248.
Furukawa TA, Noma H, Caldwell DM, Honyashiki M, Shinohara K, Imai H, et al. Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatr Scand. 2014;130(3):181–92. https://doi.org/10.1111/acps.12275.
Locher C, Koechlin H, Gaab J, Gerger H. The other side of the coin: Nocebo effects and psychotherapy. Front Psychiatry. 2019;10:555. https://doi.org/10.3389/fpsyt.2019.00555.
O’Leary KD, Borkovec TD. Conceptual, methodological, and ethical problems of placebo groups in psychotherapy research. Am Psychol. 1978;33(9):821–30. https://doi.org/10.1037//0003-066X.33.9.821.
Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. https://doi.org/10.1136/bmj.l4898.
Lindström D, Sundberg-Petersson I, Adami J, Tönnesen H. Disappointment and drop-out rate after being allocated to control group in a smoking cessation trial. Contemp Clin Trials. 2010;31(1):22–6. https://doi.org/10.1016/j.cct.2009.09.003.
Craske M, Roy-Byrne P, Stein M, Sullivan G, Sherbourne C, Bystritsky A. Treatment for anxiety disorders: efficacy to effectiveness to implementation. Behav Res Ther. 2009;47(11):931–7.
World Medical Association. World Medical Association declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA. 2013 [cited 2022 Dec 30];310(20):2191–4. Available from: https://jamanetwork-com.proxy.library.uu.nl/journals/jama/fullarticle/1760318.
Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT revised - improving the reporting of randomized trials. JAMA. 2013;10(1):28–55.
We would like to thank all patients, therapists, supervisors and research assistants who will participate in the study. We appreciate advice given by our consultants, prof. dr. Marcel van den Hout and prof. dr. Rens van de Schoot. Additionally, we thank the management of Altrecht and Mondriaan for enabling the implementation of the study in the treatment centers. Finally, we thank Suzanne van Veen for her involvement in the conceptualization and design of the study, and Carmen van den Bulck and Sanne Beishuizen for coordinating the study as research assistants.
The IMPROVE-study is funded by a VICI grant for innovational research (453–15-005) awarded to Prof. dr. Iris Engelhard by the Dutch Research Council (NWO). The sponsor (NWO) had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results. As part of the funding process, the sponsor peer-reviewed the study protocol. The funding body The sponsor promotes open science and knowledge utilization. NWO: P.O. Box 93138, 2509AC The Hague, https://www.nwo.nl/
Ethics approval and consent to participate
The research protocol has been approved by the Medical Ethical Committee of University Medical Center Utrecht (NL73918.041). Before enrolment in the study, participants will be informed about the nature of the study, its purpose, procedures, expected duration, benefits, and risks involved in study-participation through the study information brochure and an information session. If patients are willing and eligible to participate, written informed consent will be obtained. Therapists and researchers will indicate that participating in the study is entirely voluntary and refusing to take part in the study is without any negative consequence. Patients will also be informed about their right to withdraw from the study at any time. Withdrawal from the study will not influence further treatment. All adverse events will immediately be reported to the IRB. Adverse events will be reported in papers, after completion of the trial. Insurance for all patients in the trial is covered by Utrecht University in case of adverse events. The information is given in the original IRB-proposal. The study will be conducted according to the principles of the Declaration of Helsinki (64th version, October 2013) , following the Medical Research Involving Human Subjects Act (WMO) and reported in line with the CONSORT guidelines .
Consent for publication
Suzy Matthijssen and Ad de Jongh receive fees from teaching and/or supervising psychologists in EMDR therapy and exposure therapy by means of seminars, workshops, conferences and book royalties. For this study, the Digital_EMDR app was made available free of charge by MOOVD, a company specializing in virtual reality applications in the treatment of mental health. Suzy Matthijssen and Ad de Jongh participate in the MOOVD advisory board (stipendiary). Agnes van Minnen receives fees from teaching and supervising psychologists exposure therapy by means of seminars, workshops, conferences and book royalties. All other authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Endhoven, B., De Cort, K., Matthijssen, S.J.M.A. et al. Eye movement desensitization and reprocessing (EMDR) therapy or supportive counseling prior to exposure therapy in patients with panic disorder: study protocol for a multicenter randomized controlled trial (IMPROVE). BMC Psychiatry 23, 157 (2023). https://doi.org/10.1186/s12888-022-04320-4
- Exposure Therapy
- Eye Movement Desensitization and Reprocessing (EMDR) therapy
- Supportive Counseling
- Randomized Controlled Trial
- Anxiety Disorder
- Panic Disorder
- Cognitive-Behavioral Therapy (CBT)