We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
How to customize a bona fide psychotherapy for generalized anxiety disorder? A two-arms, patient blinded, ABAB crossed-therapist randomized clinical implementation trial design [IMPLEMENT 2.0]
BMC Psychiatryvolume 18, Article number: 86 (2018)
Bona fide psychotherapy approaches are effective treatments for generalized anxiety disorder (GAD) compared to no-treatment conditions. Treatment manuals and protocols allow a relatively high degree of freedom for the way therapists implement these overall treatment packages and there is a systematic lack of knowledge on how therapists should customize these treatments. The present study experimentally examines two implementation strategies of customizing a bona fide psychotherapy approach based on a 16 session time-limited cognitive-behavioral therapy (CBT) protocol and their relation to the post-session and ultimate treatment outcomes.
This trial contrasts two different implementation strategies of how to customize the in-session structure of a manual-based CBT-protocol for GAD. The patients will be randomly assigned to two implementation conditions: (1) a systematic focus on subtle changes lasting from 7 to 20 min at the check-in phase of every psychotherapy session and (2) a state-of-the-art (SOTA) check-in phase lasting several minutes mainly focused on the session goals. Potential therapist effects will be examined based on an ABAB crossed-therapist design. Treatment outcomes will be assessed at the following times: post-session outcomes, treatment outcome at post assessment and 6- as well as 12-month follow-up.
The proposed randomized clinical implementation trial addresses the clinically relevant question of how to customize a bona fide psychotherapy protocol experimentally contrasting two implementation strategies. Through the development and testing of the proposed implementation design, this trial has the potential to inform therapists about efficacious implementation strategies of how to customize a manual-based treatment protocol in respect to the timing of the in-session structure.
Personalized medicine refers to several efforts of tailoring interventions to the characteristics of each individual patient (e.g. [1, 2]). For psychotherapy, one can argue, that personalization of treatments is already part of the clinical reality of most practitioners (e.g. [3, 4]). However, evidence-based guidelines of how to customize treatments and how to more specifically structure the sessions are largely missing. This might in part be due to the fact that in psychotherapy and in human treatments more generally, not only does patient heterogeneity need to be taken into account, but potentially also that of the therapist and their collaborative qualities between each other.
Within the over 25,000 hits in relevant data bases during the past 5 years referring to randomized controlled trial design in human interventions, based on a search at February 2018 in Medline, PsychINFO and ERIC, there is a lack of sensitivity to heterogeneity in therapists’ effectiveness (i.e. therapist effects) and a lack of systematized knowledge about how therapists implement their treatments . There is a need for further work developing and testing study designs that investigate therapist effectiveness and related therapists’ implementation strategies [6,7,8,9].
The present study design represents an important step toward addressing this gap by investigating two implementation strategies along therapist and patient variability with a bona fide psychotherapy approach for individuals that suffer from generalized anxiety disorder (GAD). We are conducting a novel two-arms, patient blinded, ABAB crossed-therapist randomized controlled implementation trial design.
Therapist effects in randomized clinical trials
Blinded allocation of patients and health professionals is an important claim in double-blind randomized pharmaceutical trials. It is a well-known consideration for the identification of a true treatment effect and for avoiding potential confounding effects from patients and health professionals. In evidence-based human interventions, health professionals can not be blinded, because hopefully they are well-informed and fully aware of the interventions that they apply (e.g. the professionals apply a specified surgery, educational program, or psychological intervention). Such conditions are common in human interventions of evidence-based medicine , nursing , social work , education , and psychological interventions more generally [5, 14].
There are at least three positions regarding the debate about non-blinded therapist conditions and how to handle potential therapist effects in human interventions: (1) advocates for double-blind trial designs highlight general biases of non-blinded allocations, assuming that blinded conditions may help to eliminate potential confounding effects (e.g. ), (2) advocates of evidence-based human interventions often emphasize uniformity of evidence-based treatments without considering therapist effects as a potential confounder, i. e. potential therapist effects often are neglect at the analyses and discussion sections when conducting study designs where patients are nested in therapists (see ), and (3) a third way to investigate therapist effects either in non-blinded as well as blinded conditions lies in the direct investigation of these potential effects and the development of study designs that allow for the estimation of such effects; i.e. therapist effects considered as true effects rather than biases or confounders (see [5, 17]).
Crossed-therapist designs were proposed for naturalistic intervention studies [18, 19], where each therapist is allocated into two or more treatment conditions, and therefore potential differences in overall therapist effectiveness can be estimated across conditions. However, the therapists’ individual treatment preferences for a certain condition may impact her effectiveness across conditions, and thus, therapist preferences should be explicitly assessed in such designs [5, 19].
Generalized anxiety disorder
Randomized controlled trials usually are focused on one particular patient population (e.g. by specifying disorders or particular contexts of suffering) to reduce the patient variability and to enhance the precision of research results. Uncontrollable worry is a primary symptom of GAD and constitutes a maladaptive cognitive strategy to avoid the experience of anxiety  and other emotional states [21, 22]. Individuals who suffer from GAD show deficits in detecting and regulating emotional states, which might accelerate a positive feedback circuit between general stress symptoms and pathological worrying (e.g. ). Experiential avoidance might lead to a restriction in proactive behaviors because individuals become focused on preventing negative events and maintaining safety , rather than on pursuing activities that are consistent with their personal values (e.g. ), which might impact the content of psychotherapy sessions .
Empirical evidence of bona fide psychotherapy approaches for GAD
There is meta-analytic evidence that psychotherapy conditions conducted by trained professionals that are designed to be fully therapeutic (bona fide psychotherapy; [5, 27]) are more effective treatments compared to no-treatment and treatment as usual for individuals with GAD [28,29,30] as well as for individuals who suffer from anxiety and depression comorbidities more generally [27, 31]. For cognitive-behavioral therapy (CBT), there are a number of GAD-specific interventions, such as GAD-psychoeducation, applied relaxation, restructuring of (meta-) cognitions, (imagery-) exposure, and in vivo confrontation, that primarily reference standard techniques to reduce and compensate GAD symptoms (e.g. [32,33,34,35,36,37,38,39]; but also ). In daily practice, however, it is a well-known fact that patients and therapists usually are not uniformly skilled. On a broader perspective psychotherapy dialogues were observed to be highly collaborative and responsive treatments, through which therapists as well as patients work together to achieve well-specified treatment goals that consider the patients’ entire living environment [41,42,43,44].
Therapist’s responsiveness to subtle patient changes
It is a robust finding in psychotherapeutic as well as pharmacological mental health treatments that sudden patient’ changes commonly occur independently of the intake severity. For example, sudden symptom changes (sudden gains) occur in approximately 20–40% of all clients, up to 60–80% in those who benefit from treatment in general [45,46,47,48,49], and in GAD more specifically [50, 51]. Whereas such research focuses on sudden symptom reduction of particular symptoms [52, 53], other investigators highlight psychological changes involving other aspects of a comprehensive definition of health  including substantial as well as more subtle changes in wellbeing and psychosocial functioning [47, 55,56,57,58,59].
From a therapist’s implementation perspective, detecting and integrating subtle patient changes, even small and subtle ones, in a more systematic manner might impact the treatment processes and its outcomes [46, 59]. It is likely that many therapists already respond to sudden gains and subtle changes, and in this way, help to regulate the “speed” of therapeutic change and the consolidation of gains achieved [47, 60]. Even though subtle changes seem to occur in many psychotherapies, to the best of our knowledge, there is no trial that systematically takes advantage of such changes using rigorous randomized controlled trial methodology. There is a need for future research in this area, especially because subtle changes are apparent in many mental health conditions [45,46,47, 57, 59, 61,62,63].
In a prior three-arm, single-blinded, randomized controlled implementation trial (IMPLEMENT 1.0; ) we recruited 57 adults with GAD to participate in a cognitive behavioral treatment approach very similar to the approach used in our current trial. We randomly assigned eligible patients to three different priming conditions: (1) adherence priming, in which the peer-priming with the therapist had a systematized focus on patients’ individual GAD symptoms and how to compensate for these symptoms within the manual, (2) resource priming, in which the peer-priming with the therapist had systematized foci on patients’ strengths and abilities and how these strengths can be capitalized within the same package and (3) supportive resource priming (that additionally allowed the invitation of a supportive person into therapy sessions). The results indicated that all three priming conditions showed a highly significant reduction of symptoms over time. However, compared with the adherence priming condition, both resource priming conditions indicated faster symptom reduction during treatment. In contrast to this past trial where the implementation conditions focused on different peer-priming strategies, in the present implementation trial we focus on contrasting two implementation strategies that focus on taking different approaches to subtle change made by the patient.
Aims of the implementation trial
Rather than contrasting increasing numbers of new overall treatment-packages, an additional approach may be to increase the understanding of fine-grained implementation strategies within already effective psychotherapies. Such research questions require the development of novel randomized clinical implementation designs that simultaneously investigate potential implementation effects along with therapist as well as patient effects .
This trial investigates two different implementation strategies of customizing a bona fide psychotherapy based on a well-introduced CBT-protocol for GAD . The patients will be randomly assigned to two implementation conditions: (1) a systematic focus on subtle changes lasting from 7 to 20 min at the check-in phase of every psychotherapy session [61, 65]; and (2) a state-of-the-art (SOTA) check-in phase lasting several minutes mainly focused on the session goals. Potential therapists’ implementation effects will be examined based on an ABAB therapist allocation (see design). The main research questions are as follows:
Practicability: Is the newly developed randomized clinical implementation trial design and particularly the therapists’ ABAB allocation practicable (ABAB crossed-therapist design), and what are the specific challenges when conducting such a structured design at the patient as well as therapist level?
Post-session outcomes: Are there differences in process evaluations measured by post-session reports for the two implementation conditions? Furthermore, are early post-session outcomes predictors of symptom change and mediators of ultimate therapy outcome (e.g. )?
Treatment outcomes: What are the differences in the treatment efficacy of the two randomized implementation conditions, (1) in dropout rates, (2) in self-reported primary and secondary outcomes ?
Therapist effects: Are the implementation effects robust across therapists? Is there an interaction effect between potential therapists’ preferences for a particular implementation condition and outcome?
It is a common data structure in human interventions that patients are nested within therapists. The proposed randomized controlled design systematize both levels, i. e. patient as well as therapist level (Fig. 1 for the nested design):
At patient level: Eighty patients will be allocated within a traditional 2 × 4 randomized controlled design with one between-subject factor (systematic focus on subtle changes vs. SOTA check-in phase) and one within-subject factor (assessment times: pre-, intermediates-, post-treatment and follow-ups).
At therapist level: Twenty therapists will each conduct four therapies using an ABAB-design randomly starting with a SOTA check-in phase or a systematic focus on subtle changes (80 patients). Overall, this ABAB crossed-therapist design allows us to integrate across what might be considered single case studies of 20 therapists . An advantage of this design is, that within-subject effects can be estimated. However, multiple observations may also lead to learning effects, and potential carry over effects may be detected from the therapist’s first to the fourth therapy. Most importantly, however, such therapist effects are not considered as effects that have to be eliminated. Rather, the longitudinal, multilevel design allows us to estimate therapist effects in parallel to the implementation effects .
Inclusion/exclusion criteria: Participants will be included in the study if they: (1) are 18 years or older; (2) agree to the informed consent, (3) can speak German; and (4) fulfill the diagnostic criteria of GAD DSM-5. Participants will be excluded for the following reasons: (1) they have a score of 2 or higher on the suicide item of the Beck Depression Inventory and/or are found to have active suicidal plans during the diagnostic screening interview, (2) they are currently taking a psychotic or bipolar disorder medication, or (3) they are currently receiving treatment from a professional psychotherapist. Prescribed medications for anxiety or depressive disorders do not lead to exclusion from the study, if the dosage has remained constant for at least 1 month. The presence of comorbidities does not result in exclusion from the study, if GAD is in the foreground according to the severity rating of the Diagnostic Interview for DSM-diagnoses.
Recruitment: Participants will be recruited by e-mail distributors of internet forums. Individuals interested in participating in the study will contact the study office via SMS, e-mail or phone. Positively screened patients will be invited for an intake assessment to determine whether they will be included or excluded using a standardized diagnostic interview. Participants that are not screened positively will be informed of more appropriate treatments via a phone call or, if requested, a face-to-face contact.
Randomization and treatment allocation. After meeting the inclusion criteria, patients will be randomly assigned to one of the two implementation conditions (systematic focus on subtle changes or SOTA check-in phase). Treatment allocation is performed using an online application for full randomization. The whole randomization procedure will be conducted by an independent person outside of the project implementation. In this way, we aim to ensure that the trial arms are fully randomized with respect to the patients’ baseline characteristics. Because all patients will be treated using the same CBT-manual, patients are blinded to their treatment allocation and are not informed about the randomization procedure.
GAD treatment protocol
Modern CBT for GAD typically consists of psychoeducation, relaxation training and/or mindfulness exercises (RT/M), cognitive restructuring (CR) and imagery exposure (IE) as major interventions to address the various GAD-related problems. The “Mastery of your Anxiety and Worry” manual (MAW-package) is a well-structured, and internationally well-introduced cognitive-behavioral treatment [39, 68]. In the present study, the MAW-package will be applied within a usual 16-session individual therapy format and up to three further booster sessions. The treatment protocol was based on a 16-h workshop presented by one of the co-developers of the treatment manual. The MAW-package consists of (1) psychoeducation regarding the nature of GAD and the rationale for the treatment program (sessions 1 and 2), (2) RT/M (sessions 3 and 4 and portions of sessions thereafter), (3) CR (sessions 5, 6 and 7 and portions of sessions thereafter), (4) IE (sessions 8–12), and (5) plans for maintenance, relapse prevention and termination (sessions 13–16). However, the implementation of an bona fide treatment is largely principle-based, allowing considerable therapeutic flexibility in determining and timing of different treatment aspects.
The session format of 50–60 min usually consists of (1) a check-in phase of 5 to 10 min that includes patients welcoming, reviewing self-help and agenda setting, (2) a working phase around 35–45 min that focuses on the previously agreed session goals, (3) a feedback phase of 5 to 10 min that summarizes the session and includes a negotiation of the upcoming self-help assignment.
Implementation conditions: In-session structure
The session check-in phase will be systematically varied by the following two conditions while keeping the overall session lengths of 50–60 min constant:
State-of-the-art (SOTA) check-in phase: The therapists will apply the usual SOTA check-in phase lasting between 5 to 10 min, as recommended in the preexisting guideline including reviewing progress in self-help and agenda setting . In this condition progress, subtle changes and sudden gains may be an explicit topic and there is no restraint to talks about topics. However, the therapists are not obligated to take a systematic focus on potential subtle changes and they may use the timing of the sessions to involve the patients into the other phases of therapy.
Prolonged focus on subtle changes: Based on the robust findings that over 90% of the patients will experience subtle changes [69, 70] e.g. apparent at the pre-session assessments, the therapists will extend the above-mentioned check-in phase to 7 up to 20 min in which small and subtle changes are systematically worked with. These subtle changes will further be explored by focusing on the following aspects [61, 71]: (1) the precise change situation, (2) related emotional states, (3) related helpful thoughts and self-verbalizations, (4) reinforcement of generalized self-efficacy and treatment motivation, (5) benefit for the upcoming session goals. Exploratory video analyses of GAD patients indicated that the explicit examination of the patients’ changes and immediate competencies usually observed at the check-in phase was highly associated with therapy success .
Twenty psychologists with a master degree and participating in post-graduate psychotherapy trainings are recruited from local psychotherapy-training centers. In addition to the clinical internships, these systematized 5-year postgraduate training includes (1) 600 h of weekend workshops for psychotherapy interventions in single, couple, and group settings, (2) 200 h of supervision, and (3) 200 h of personal therapy. Some of those therapists have experience as study administrators in a prior randomized controlled trial for GAD (ClinicalTrials.gov Identifier: NCT02039193). All therapists will participate in an initial 16-h workshop presented by one of the co-developers of the treatment manual (Zinbarg) . The therapists will be regularly supervised in small groups on a bi-weekly basis. The supervision is conducted in mixed groups for all conditions. All supervisors also participate in the initial 16-h workshop. For a therapist performing an ABAB sequence of conditions, the therapy will be performed as followed: First therapy in the SOTA-check-in phase condition, second therapy in the prolonged focus on subtle changes condition, third therapy with the SOTA check-in phase condition, forth therapy with the prolonged focus on subtle changes condition (ABAB sequence); the other half of the therapists will start with the prolonged focus on subtle changes condition (BABA sequence).
For an overview of the assessments see Table 1. At intake, GAD-diagnosis and its core symptomatology is identified according to the structured interview section for GAD (DIPS; ). Furthermore, GAD-criteria are assessed using self-reports. The individual worries are identified using the Penn State Worry Questionnaire (PSWQ; ) and the Worry Domain Questionnaire (WDQ; [74, 75]). Mental disorders on Axis I are assessed using face-to-face diagnostic interviews (Strukturiertes Klinisches Interview für DSM, SKID-I; ).
GAD-specific (primary) outcomes: The Penn State Worry Questionnaire (PSWQ; ) is a 16-item measure of the frequency and intensity of worry. It has considerable internal consistency (α = 0.86 in the prior trial). The Beck Anxiety Inventory (BAI; ) is a 21-item measure for anxiety symptoms (α = 0.92 in the prior trial).
General (secondary) outcomes: The Beck Depression Inventory II (BDI-II; ) is a 21-item measure for depressive symptoms (α = 0.92 in the prior trial). The 9-item short version of the Symptom Check List (SCL-9; ) is an index for general severity (α = 0.86 in the prior trial). The short version of the Resource Self-Report Questionnaire (RES; ) measures various domains of individual and interpersonal strengths (α = 0.92 in the present sample).
In the prior trial, all GAD and general outcome self-report assessments were highly correlated (0.74 > r > 0.47) and a principal component factor analysis extracted one component that explained 67.5% of the total variance. For the purposes of the present trial, we therefore intend to include a standardized composite measure (“outcome composite”) that takes all the five GAD and general self-report measures into account (α = 0.73 in the prior trial; see also  for psychotherapy outcome definitions).
Post-session outcomes: The following process measures are examined: (a) Post-session outcomes (evaluated by therapists and patients): Working Alliance Inventory (WAI) [82, 83], Bern Post-Session Reports (BPSR) , and PSWQ patient self-report symptom status are conducted based on a session-by-session assessment from session 1 to 16. Furthermore, patient and therapist outcome expectations as well as therapist implementation preferences and in-session focus on subtle change will be assessed based on self-report items.
Safety outcomes: Suicidal ideation is assessed as safety outcome in the structured assessment at baseline, post, and follow-up measures and if indicated in every therapy session. As an outcome, suicidal ideation is assumed when the suicidal ideation item of the BDI is endorsed with a value > 1. In this case, individuals will be immediately contacted by telephone for further assessment and coordination as well as decisions for more appropriate treatments will be based on the general psychotherapeutic guidelines for suicidal ideation .
Along more traditional statistical approaches to handle the nested data structures, Longitudinal Multilevel Modeling (MLM) will be used to analyze the (intensive) longitudinal, nested data structures [86,87,88,89]. This data-analytical approach is specifically suitable to analyze the type of data that will be collected in the proposed implementation trial. For the primary research questions for post-session and treatment outcomes, MLM with time as a repeated within-group factor and implementation condition as a between-groups factor will be used . A benefit of MLM, in comparison to traditional ANOVA with repeated measures lies in the individual parameterization of the process variables over various levels (repeated measures as random variables; ). The main analyses will be conducted on the intention-to-treat sample and the completer data. Between-group effect sizes will be based on pre-post within control Cohen’s dppwc suggested by Carlson and Schmidt  which is a mean difference estimate that takes into account both intake values at pretreatment and differences between each treatment condition.
The following analysis estimates the treatment efficacy of the two implementation conditions using random effects multilevel models . To consider the variance components at each level (assessment times nested in patients and therapists), we will conduct 3-level models where the repeated assessments of the primary outcome at level 1 will be nested within patients at level 2 and therapists at level 3 (for a comparable model see e.g. ). Using a step-by-step approach , the growth models potentially will end up in a multi-predictor model to investigate the main outcome-predictors at each level simultaneously. An example of such a model is: At Level 1 (assessment level),
PSWQ ijk = π0jk + π1jk(time) + e ijk
where PSWQ ijk is the estimated value of the Penn State Worry Questionnaire (PSWQ) within a time-specific assessment of each patientj and therapistk; π 0jk represents the intake-centered intercept of the repeated PSWQ-measures within each patient; π 1jk (time) represents the decrease of symptoms from pretreatment up to post-treatment, and e ij represents the corresponding error term.
At Level 2 (patient level),
for intercept: π0jk = ß00k + ß01k(number of comorbidities) + r0jk.
for time: π1jk = ß10k + ß11k(implementation condition) + r1jk.
where π 0jk is the estimate of the true population overall patients’ intake PSWQ and π 1jk is the estimation of the overall symptom reduction across the repeated assessments. Further, ß 00k and ß 10k are the estimated overall grand means of PSWQ intercept and time, and ß 01k (number of comorbidities) and ß 11k (implementation condition) represent the specific patients’ level predictors on intercept π 0jk and growth π 1jk respectively. Finally, r0jk and r 1jk are the corresponding error terms at the patients’ level.
At Level 3 (therapist level):
ß00k = γ000 + u00k
ß01k = γ010
ß10k = γ100
ß11k = γ110 + γ111(therapists’ implementation preference) + u11k
where ß 00k is the estimate of the true population therapists’ overall intake PSWQ and ß 10k is the corresponding overall true population symptom reduction among therapists; ß 01k and ß 11k are the overall therapists’ true population estimations of the level 2 predictors. Furthermore, γ 000 and γ 100 are the estimated overall grand means of PSWQ intercept and time at therapists’ level, γ 111 (therapists’ implementation preference) is the hypothesized therapists’ preference on the implementation condition ß 11k . Finally, u 00k and u 11k are the corresponding error terms at the therapist level (see also [6, 93] for a conceptual frame).
The various multi-predictor models will be compared using Akaike information criterion (AIC) and the Bayesian information criterion (BIC; see ) and deviance test of variance components respectively .
With respect to the differences between the two comparative conditions, based on prior studies with transdiagnostic disorders , social phobia , depression , and GAD , we planned to demonstrate a medium effect size of Cohen’s d = 0.40 between the implementation conditions on the outcome composite. Assuming an α error level of 0.05, a statistical power (1-Beta) of 0.80, and a correlation of 0.40 between the pre- and post-measurements, the proposed study of 40 participants in each condition treated by 20 therapists is able to detect such an effect size .
Treatment protocols allow a relatively high degree of freedom for the way therapists implement the treatment protocols. The present design is one of the very first trials that experimentally examine the therapists’ sensitivity to changes and its relation to treatment outcome. More specifically, two implementation strategies of session structuring (SOTA check-in phase, prolonged focus on subtle changes) are compared to each other in the same overall treatment package.
The hierarchical structure of the systematized design allows the simultaneous examination of patients’ and therapists’ contributions. In contrast to pharmaceutical trials, therapists and patients are informed and (hopefully) proactively involved in the psychotherapeutic treatment. This involvement is not a bias which has to be eliminated; it might rather be an active ingredient of a successful psychotherapy in which the therapists and the patients take a proactive and collaborative role in the treatment plan . Therefore, the present design allows to experimentally investigate some potentially meaningful aspects of this responsive proactivity.
The hierarchical structure of the implementation design allows a systematic investigation of patients’ as well as the therapists’ contributions simultaneously; and in one further implementation aspect, it allows to examine an experimental contrast (SOTA check-in phase vs. prolonged focus on subtle changes check-in phase). But for the similarities and differences of the proposed randomized clinical implementation trial with the common randomized clinical trial design see Table 2.
Patients: Patients will be randomly assigned to conditions to reduce systematic selection biases in participant characteristics. The inclusion and exclusion criteria allow for a relatively homogeneous group of individuals with GAD diagnoses. In traditional trials, where two or more distinctive treatment protocols are compared to each other, patients have to be informed about the various randomized treatment conditions of the active treatments (e.g. psychotherapy vs. waiting list). Therapist will apply the very same bona fide psychotherapy protocol in both conditions. Implementation-strategies are part of the therapist individual case preparation. Based on common practice, therapists are not obligated to inform the patient about any specific topic of therapist case preparation, related supervision, or personalized implementation strategies. Therefore, implementation condition can be blinded for the patient at every time of the study conduction. This is one of the very first designs that allows for blinded patient conditions which minimizes some of the potentially major concerns of the more traditional randomized controlled trials of psychotherapy and psychological interventions more generally.
Therapists: A potential bias due to the therapist preferences is a concern, especially in human treatments where inductions of outcome expectations can be impactful for patients as well as therapists. In the proposed design, potential therapist effects are not considered as a bias that has to be eliminated. In contrast, due to the nested data structure, the present ABAB crossed-therapist design is able to take into account such possible effects . Furthermore, this design allows systematizing potential implementation effects within therapists.
Researchers: The existence of researcher allegiance effects is a robust meta-analytic finding in both comparative (e.g. ) and correlative designs (e.g. ). In many randomized controlled trials, maximally distinctive treatment protocols are contrasted with each other (e.g. cognitive behavioral therapy vs. psychodynamic therapies; online vs. face-to-face treatments, additive components vs. standard treatment). Imbalances in researcher allegiance might favor one treatment, sometimes very explicitly and sometimes more subtly. For example, some patients might have been attracted by a specific intervention and therefore self-selected the specialized clinic, but were randomized in the alternative treatment. Another example is that the designed control groups are intended to not be fully therapeutic [not bona fide, 5]. Even though we presented some literature of how to innovate state-of-the-art CBT (what might be an indicator for researcher allegiance in favor to the prolonged focus on subtle changes condition), both interventions are designed to be fully therapeutic within the very same bona fide treatment package. Therefore, the aim of the present investigation is not to contrast distinctive treatments packages. The aim is rather to keep the overall treatment package constant in order to investigate a relevant clinical research question of treatment implementation (i. e. therapist consideration of subtle patient change) within a treatment package. Nonetheless, despite the awareness of potential researcher allegiance effects in our research team, it might be difficult to fully eliminate such effects over the course of the lasting study implementation. Hence, during the publication process we will discuss this potential limitation cautiously.
To conclude, an essential contribution of this study will be to better understand successful implementation strategies of how to customize a manual-based psychotherapy in respect to the session timing. In addition, the present randomized controlled implementation trial may provides further insights about therapist effects based on a ABAB crossed-therapist allocation where patients can be fully blinded about their implementation condition. Most relevant, the present study protocol may sensitize for potential implementation effects when conducting randomized controlled trials in human interventions.
Beck anxiety inventory
Beck depression inventory - version II
Bern post-session reports
Cognitive behavioral therapy
Diagnostic and statistical manual of mental disorders - version 5
Generalized anxiety disorder
Mastery of your anxiety and worry package
Penn state worry questionnaire
Resource self-report questionnaire
Relaxation training and/or mindfulness exercise
Structured clinical interview for dsm-diagnostics
Symptom check list
Working alliance inventory
Worry domain questionnaire
Hamburg MA, Collins FS. The path to personalized medicine. N Engl J Med. 2010;363(4):301–4.
National Research Council. Toward precision medicine: building a knowledge network for biomedical research and a new taxonomy of disease. Washington, D.C: National Academies Press; 2011.
Lambert MJ. Introduction and historical overview. In: Lambert MJ, editor. Bergin and Garfield's handbook of psychotherapy and behavior change. New York: John Wiley & Sons; 2013. p. 3–20.
Perlis RH. Abandoning personalization to get to precision in the pharmacotherapy of depression. World Psychiatry. 2016;15(3):228–35.
Wampold BE, Imel ZE. The great psychotherapy debate: the evidence for what makes psychotherapy work. 2nd ed. New York: Routledge; 2015.
Baldwin SA, Imel Z. Therapist effects: findings and methods. In: Lambert MJ, editor. Bergin and Garfield's handbook of psychotherapy and behavior change. New York: John Wiley & Sons; 2013. p. 258–97.
Hoover DR. Clinical trials of behavioural interventions with heterogeneous teaching subgroup effects. Stat Med. 2002;21(10):1351–64.
Lee KJ, Thompson SG. Clustering by health professional in individually randomized trials. BMJ. 2005;330(7483):142–4.
Walters SJ. Therapist effects in randomized controlled trials: what to do about them. J Clin Nurs. 2010;19:1102–12. https://doi.org/10.1111/j.1365-2702.2009.03067.x.
Athanasiou T, Debas H, Darzi A. Key topics in surgical research and methodology. Heidelberg: Springer; 2010.
Newhouse RP. Creating infrastructure supportive of evidence-based nursing practice: leadership strategies. Worldviews Evid-Based Nurs. 2007;4(1):21–9.
Soydan H. Evidence-based medicine and knowledge dissemination, translation, and utilization: challenges of getting evidence-based treatments to patient care and service delivery. J Evid Based Med. 2009;2(3):143–9. https://doi.org/10.1111/j.1756-5391.2009.01031.x.
Slavin R. Evidence-based education policies: transforming educational practice and research. Educ Res. 2002;31(7):15–21.
Barlow DH, Bullis JR, Comer JS, Ametaj AA. Evidence-based psychological treatments: an update and a way forward. Annu Rev Clin Psychol. 2013;9:1–27.
Hughes JR, Krahn D. Blindness and the validity of the double-blind procedure. J Clin Pharmacol. 1985;5:138–42.
Laska KM, Smith TL, Wislocki AP, Minami T, Wampold BE. Uniformity of evidence-based treatments in practice? Therapist effects in the delivery of cognitive processing therapy for PTSD. J Couns Psychol. 2013;60(1):31.
McKay KM, Imel ZE, Wampold BE. Psychiatrist effects in the psychopharmacological treatment of depression. J Affect Disord. 2006;92(2):287–90.
Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D, group C, Pragmatic Trials in Healthcare g. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.
Falkenström F, Markowitz JC, Jonker H, Philips B, Holmqvist R. Can psychotherapists function as their own controls? Meta-analysis of the “crossed therapist” design in comparative psychotherapy trials. J Clin Psychiatry. 2013;74(5):482–91.
Borkovec TD, Alcaine O, Behar E. Avoidance theory of worry and generalized anxiety disorder. In: Heimberg RG, Turk CL, Mennin DS, editors. Generalized anxiety disorder: advances in research and practice. New York: Guilford Press; 2004. p. 77–108.
Roemer L, Salters K, Raffa SD, Orsillo SM. Fear and avoidance of internal experiences in GAD: preliminary tests of a conceptual model. Cogn Ther Res. 2005;29(1):71–88.
Newman MG, Llera SJ. A novel theory of experiential avoidance in generalized anxiety disorder: a review and synthesis of research supporting a contrast avoidance model of worry. Clin Psychol Rev. 2011;31(3):371–82.
Mennin DS, McLaughlin KA, Flanagan TJ. Emotion regulation deficits in generalized anxiety disorder, social anxiety disorder, and their co-occurrence. J Anxiety Disor. 2009;23(7):866–71.
Strauman TJ, Socolar Y, Kwapil L, Cornwell JF, Franks B, Sehnert S, Higgins ET. Microinterventions targeting regulatory focus and regulatory fit selectively reduce dysphoric and anxious mood. Behav Res Ther. 2015;72:18–29.
Michelson SE, Lee JK, Orsillo SM, Roemer L. The role of values-consistent behavior in generalized anxiety disorder. Depress Anxiety. 2011;28(5):358–66.
Flückiger C, Zinbarg RE, Znoj H, Ackert M. Resource activation in generalized anxiety—an observer-based microprocess analysis of patients’ in-session outcomes. Psychotherapy. 2014;51(4):535–45.
Wampold BE, Budge SL, Laska KM, Del Re A, Baardseth TP, Flűckiger C, Minami T, Kivlighan DM, Gunn W. Evidence-based treatments for depression and anxiety versus treatment-as-usual: a meta-analysis of direct comparisons. Clin Psychol Rev. 2011;31(8):1304–12.
Mitte K. Meta-analysis of cognitive-behavioral treatments for generalized anxiety disorder: a comparison with pharmacotherapy. Psychol Bull. 2005;131(5):785–95.
Hanrahan F, Field AP, Jones FW, Davey GC. A meta-analysis of cognitive therapy for worry in generalized anxiety disorder. Clin Psychol Rev. 2013;33(1):120–32.
Cuijpers P, Sijbrandij M, Koole S, Huibers M, Berking M, Andersson G. Psychological treatment of generalized anxiety disorder: a meta-analysis. Clin Psychol Rev. 2014;34(2):130–40.
Flückiger C, Del Re A, Munder T, Heer S, Wampold BE. Enduring effects of evidence-based psychotherapies in acute depression and anxiety disorders versus treatment as usual at follow-up—a longitudinal meta-analysis. Clin Psychol Rev. 2014;34(5):367–75.
Barlow DH, Rapee RM, Brown TA. Behavioral treatment of generalized anxiety disorder. Behav Ther. 1992;23(4):551–70.
Beck A, Emery G, Greenberg R. Anxiety disorders and phobias: a cognitive approach. New York: Basic Books; 1985.
Becker ES, Hoyer J. Generalisierte Angststörung. Hogrefe Verlag: Göttingen; 2005.
Borkovec T, Costello E. Efficacy of applied relaxation and cognitive-behavioral therapy in the treatment of generalized anxiety disorder. J Consult Clin Psychol. 1993;61(4):611–9.
Hoyer J, Becker ES, Margraf J. Generalized anxiety disorder and clinical worry episodes in young women. Psychol Med. 2002;32(7):1227–37.
Roemer L, Orsillo SM, Salters-Pedneault K. Efficacy of an acceptance-based behavior therapy for generalized anxiety disorder: evaluation in a randomized controlled trial. J Consult Clin Psychol. 2008;76(6):1083–98.
Wells A. A metacognitive model and therapy for generalized anxiety disorder. Clin Psychol Psychother. 1999;6(2):86–95.
Zinbarg RE, Craske MG, Barlow DH. Mastery of your anxiety and worry (MAW): therapist guide. 2nd ed. New York: Oxford University Press; 2006.
Norton PJ, Philipp LM. Transdiagnostic approaches to the treatment of anxiety disorders: a quantitative review. Psychother. 45(2):214–26.
Flückiger C, Del Re AC, Wampold BE, Horvath AO. Alliance in adults. In: Norcross J, Lambert MJ, editors. Psychotherapy relationship that work. 3rd ed. New York: Oxford University Press. in press.
Horvath AO. Research on the alliance: knowledge in search of a theory. Psychother Res. 2017; https://doi.org/10.1080/10503307.2017.1373204.
Norcross J, Lambert MJ. Psychotherapy relationships that work. 3rd ed. New York: Oxford University Press. in press.
Stiles W, Horvath A. Appropriate responsiveness as a contribution to therapist effects. In: Castonguay L, Hill C, editors. How and why are some therapists better than others? Washington. DC: APA Books; 2017. p. 71–84.
Aderka IM, Nickerson A, Bøe HJ, Hofmann SG. Sudden gains during psychological treatments of anxiety and depression: a meta-analysis. J Consult Clin Psychol. 2012;80(1):93–101.
Haas E, Hill RD, Lambert MJ, Morrell B. Do early responders to psychotherapy maintain treatment gains? J Clin Psychol. 2002;58(9):1157–72.
Wucherpfennig F, Rubel JA, Hofmann SG, Lutz W. Processes of change after a sudden gain and relation to treatment outcome—evidence for an upward spiral. J Consult Clin Psychol. 2017;85(12):1199–210. https://doi.org/10.1037/ccp0000263.
Strunk DR, Cooper AA, Ryan ET, DeRubeis RJ, Hollon SD. The process of change in cognitive therapy for depression when combined with antidepressant medication: predictors of early intersession symptom gains. J Consult Clin Psychol. 2012;80(5):730–8. https://doi.org/10.1037/a0026455.
Vittengl JR, Clark LA, Jarrett RB. Validity of sudden gains in acute phase treatment of depression. J Consult Clin Psychol. 2005;73(1):173–82.
Deschênes SS, Dugas MJ. Sudden gains in the cognitive-behavioral treatment of generalized anxiety disorder. Cogn Ther Res. 2013;37(4):805–11.
Present J, Crits-Christoph P, Connolly Gibbons MB, Hearon B, Ring-Kurtz S, Worley M, Gallop R. Sudden gains in the treatment of generalized anxiety disorder. J Clin Psychol. 2008;64(1):119–26.
Tang TZ, DeRubeis RJ. Sudden gains and critical sessions in cognitive-behavioral therapy for depression. J Consult Clin Psychol. 1999;67(6):894–904.
Norton PJ, Klenck SC, Barrera TL. Sudden gains during cognitive–behavioral group therapy for anxiety disorders. J Anxiety Disord. 2010;24(8):887–92.
World Health Organization. Constitution of the world Heath Organization. Geneva: World Health Organization; 1948.
Goldberg SB, Rousmaniere T, Miller SD, Whipple J, Nielsen SL, Hoyt WT, Wampold BE. Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. J Couns Psychol. 2016;63(1):1–11.
Howard KI, Lueger RJ, Maling MS, Martinovich Z. A phase model of psychotherapy outcome: causal mediation of change. J Consult Clin Psychol. 1993;61(4):678–85.
Lutz W, Stulz N, Köck K. Patterns of early change and their relationship to outcome and follow-up among patients with major depressive disorders. J Affective Disord. 2009;118(1):60–8.
Rubel J, Lutz W, Schulte D. Patterns of change in different phases of outpatient psychotherapy: a stage-sequential pattern analysis of change in session reports. Clin Psychol Psychother. 2015;22(1):1–14.
Stulz N, Lutz W. Multidimensional patterns of change in outpatient psychotherapy: the phase model revisited. J Clin Psychol. 2007;63(9):817–33.
Flückiger C, Holtforth MG. Ressourcenaktivierung und motivorientierte Beziehungsgestaltung: Bedürfnisbefriedigung in der Psychotherapie. In: Frank R, editor. Therapieziel Wohlbefinden: Ressourcen aktivieren in der Psychotherapie. Heidelberg: Springer; 2017. p. 35–44.
Flückiger C, Grosse Holtforth M, Del Re A, Lutz W. Working along sudden gains: responsiveness on small and subtle early changes and exceptions. Psychotherapy. 2013;50(3):292–7.
Greenfield MF, Gunthert KC, Haaga DA. Sudden gains versus gradual gains in a psychotherapy training clinic. J Clin Psychol. 2011;67(1):17–30.
Owen J, Hilsenroth MJ. Treatment adherence: the importance of therapist flexibility in relation to therapy outcomes. J Couns Psychol. 2014;61(2):280–8. https://doi.org/10.1037/a0035753.
Flückiger C, Forrer L, Schnider B, Bättig I, Bodenmann G, Zinbarg RE. A single-blinded, randomized clinical trial of how to implement an evidence-based treatment for generalized anxiety disorder [IMPLEMENT]—effects of three different strategies of implementation. EBioMed. 2016;3:163–71.
Flückiger C, Wüsten G, Zinbarg R, Wampold B. Resource activation: using clients’ own strengths in psychotherapy and counseling. Bern: Hogrefe Publishing; 2010.
Flückiger C, Grosse Holtforth M, Znoj HJ, Caspar F, Wampold BE. Is the relation between early post-session reports and treatment outcome an epiphenomenon of intake distress and early response? A multi-predictor analysis in outpatient psychotherapy. Psychother Res. 2013;23(1):1–13.
Barlow DH, Hayes SC. Alternating treatments design: one strategy for comparing the effects of two treatments in a single subject. J Applied Behav Anal. 1979;12(2):199–210.
Craske MG, Barlow DH. Mastery of your anxiety and worry. New York: Oxford University Press; 2006.
Barkham M, Stiles WB, Shapiro DA. The shape of change in psychotherapy: longitudinal assessment of personal problems. J Consult Clin Psychol. 1993;61(4):667–77.
Thompson M, Thompson L, Gallagher-Thompson D, Alto P. Linear and nonlinear changes in mood between psychotherapy sessions: implications for treatment outcome and relapse risk. Psychother Res. 1995;5(4):327–36.
Flückiger C, Grosse Holtforth M, Del Re A, Lutz W. Exploration von Resilienzen und Ressourcen bei Veränderungssprüngen. Persönlichkeitsstörungen: Theorie und Therapie. 2014;18(4):235–43.
Margraf J, Schneider S, Ehlers A. Diagnostisches Interview bei psychischen Störungen (DIPS). Berlin: Springer; 1991.
Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the penn state worry questionnaire. Behav Res Ther. 1990;28(6):487–95.
Stöber J. Besorgnis: ein Vergleich dreier Inventare zur Erfassung allgemeiner Sorgen. Z Differentielle Diagnostische Psychol. 1995;16(1):50–63.
Tallis F, de Silva P. Worry and obsessional symptoms: a correlational analysis. Behav Res Ther. 1992;30(2):103–5.
Wittchen H-U, Zaudig M, Fydrich T. Skid. Strukturiertes klinisches Interview für DSM-IV. Achse I und II. Handanweisung. Göttingen: Hogrefe; 1997.
Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56(6):893–7.
Beck AT, Steer RA, Brown GK. Beck depression inventory-II. San Antonio: The Psychological Corporation; 1996.
Klaghofer R, Brähler E. Konstruktion und Teststatistische Prüfung einer Kurzform der SCL-90–R. Z Klin Psychol Psychiatr Psychother. 2001;49(2):115–24.
Trösken A, Grawe K. Inkongruenzerleben aufgrund brachliegender und fehlender Ressourcen: Die Rolle von Ressourcenpotenzialen und Ressourcenrealisierung für die psychologische Therapie. Verhaltensther Psychosoz Prax. 2004;36:51–62.
Flückiger C, Regli D, Grawe K, Lutz W. Similarities and differences between retrospective and pre–post measurements of outcome. Psychother Res. 2007;17(3):359–64.
Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the working alliance inventory. Psychother Res. 2006;16(1):12–25.
Munder T, Wilmers F, Leonhart R, Linster HW, Barth J. Working alliance inventory-short revised (WAI-SR): psychometric properties in outpatients and inpatients. Clin Psychol Psychother. 2010;17(3):231–9. https://doi.org/10.1002/cpp.658.
Flückiger C, Regli D, Zwahlen D, Hostettler S, Caspar F. Der Berner Patienten-und Therapeutenstundenbogen 2000. Z Klin Psychol Psychother. 2010;39:71–9.
Ebner G, Lehle B. Suizidalität–Erkennen, Vorgehensweisen, rechtliche Situation. Psychiatrie. 2005;4(2005):9–18.
Bolger N, Laurenceau J. Intensive longitudinal methods: an introduction to diary and experience sampling research. New York: Guilford Press; 2013.
Little TD. Longitudinal structural equation modeling. New York: Guilford Press; 2013.
Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team. nlme: linear and nonlinear mixed effects models. R Package Version. 2014;3:1–117. https://cran.r-project.org/web/packages/nlme/index.html.
Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. 2nd ed. New York: Sage; 2002.
Tasca GA, Gallop R. Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics. Psychother Res. 2009;19(4–5):429–37.
Carlson KD, Schmid FL. Impact of experimental close design on effect size: findings from the research literature on training. J Applied Psychol. 84(6):851–62.
Lutz W, Leon SC, Martinovich Z, Lyons JS, Stiles WB. Therapist effects in outpatient psychotherapy: a three-level growth curve approach. J Couns Psychol. 2007;54(1):32.
DeRubeis RJ, Gelfand LA, German RE, Fournier JC, Forand NR. Understanding processes of change: how some patients reveal more than others—and some groups of therapists less—about what matters in psychotherapy. Psychother Res. 2014;24(3):419–28.
Flückiger C, Grosse Holtforth M. Focusing the therapist's attention on the patient's strengths: a preliminary study to foster a mechanism of change in outpatient psychotherapy. J Clin Psychol. 2008;64(7):876–90.
Willutzki U, Neumann B, Haas H, Koban C, Schulte D. Zur Psychotherapie sozialer Ängste: Kognitive Verhaltenstherapie im Vergleich zu einem kombiniert ressourcenorientierten Vorghehen. Z Klin Psychol Psychother. 2004;33(1):42–50. https://doi.org/10.1026/0084-5322.214.171.124.
Cheavens JS, Strunk DR, Lazarus SA, Goldstein LA. The compensation and capitalization models: a test of two approaches to individualizing the treatment of depression. Behav Res Ther. 2012;50(11):699–706. https://doi.org/10.1016/j.brat.2012.08.002.
Magnusson K: Powerlmm. R package version 0.1.0. https://cran.r-project.org/web/packages/powerlmm/index.html 2017.
Munder T, Flückiger C, Gerger H, Wampold BE, Barth J. Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? A meta-analysis. J Couns Psychol. 2012;59(4):631–7. https://doi.org/10.1037/a0029571.
Flückiger C, Del Re A, Wampold BE, Symonds D, Horvath AO. How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. J Couns Psychol. 2012;59(1):10–7. https://doi.org/10.1037/a0025749.
We thank all 20 therapists and 80 participants at the outpatient clinic at the University of Zürich, who participate in the project. Their work will build the foundation of this study.
Swiss National Science Foundation (SNSF), Award Number: PP00P1–163702, Recipient: Christoph Flückiger.
Availability of data and materials
The data will be available from the author upon reasonable request. The raw data will not be publicly available because it contains information that could compromise the participant’s privacy. An overview of the output data is available at: http://p3.snf.ch/project-163702
Trial start date: December 14, 2016. Currently recruiting (N = 77, February 27, 2018).
Ethics approval and consent to participate
This study protocol is approved by the Ethical Committee of Canton Zurich (BASEC 2016–00773). All patients receive written information about the research project, benefits and risks of participation. They are informed that they can withdraw from the study at any time. Informed consent is obtained prior to intake assessment.
The author declares that he has no competing financial interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Generalized anxiety disorder
- Cognitive behavior therapy
- Sudden gains
- Early change
- Therapist effects
- Personalized medicine
- Randomized clinical trial
- Evidence-based practice
- Translational science