- Study protocol
- Open Access
Development of ‘learn to dare!’: An online assessment and intervention platform for anxious children
BMC Psychiatry volume 20, Article number: 60 (2020)
Many children and adolescents suffer from problematic levels of anxiety, but the multitude of these children do not receive an intervention. It is of importance to increase the accessibility and availability of child anxiety interventions, as to identify and treat anxious children early and successfully. Online platforms that include information, assessments and intervention can contribute to this goal. Interventions for child anxiety are frequently based on Cognitive Behavioral Therapy, because of its strong theoretical and empirical basis. However, the working mechanisms of Cognitive Behavioral Therapy in children are poorly studied. To our knowledge, mediation studies on child anxiety are non-existent regarding online Cognitive Behavioral Therapy.
We will aim at children aged 8–13 years with problematic anxiety. We recruit these children via the community setting, and refer them to our online platform ‘Learn to Dare!’ (in Dutch: ‘Leer te Durven!’), https://leertedurven.ou.nl, where information about child anxiety and our research is freely accessible. After an active informed consent procedure, the participants can access the screening procedure, which will select the children with problematic anxiety levels. Thereafter, these children will be randomized to an online intervention based on Cognitive Behavioral Therapy (n = 120) or to a waitlist control (WL, n = 120). The intervention consists of 8 sessions with minimal therapist support and contains psycho-education, exposure (based on inhibitory learning), cognitive restructuring and relapse prevention. Child anxiety symptoms and diagnoses, cognitions, avoidance behavior and level of abstract reasoning are measured. Assessments are the same for both groups and are performed before and after the proposed working mechanisms are offered during the intervention. A follow-up assessment takes place 3 months after the final session, after which children in the waitlist control group are offered to take part in the intervention.
This protocol paper describes the development of the online platform ‘Learn to Dare!’, which includes information about child anxiety, the screening procedure, anxiety assessments, and the online intervention. We describe the development of the online intervention. Offering easy accessible interventions and providing insight into the working mechanisms of Cognitive Behavioral Therapy contributes to optimizing Cognitive Behavioral Therapy for anxious youth.
Anxiety is a normal and functionally relevant psychological phenomenon. However, many children and adolescents suffer from problematic levels of anxiety. Anxiety disorders are the most prevalent psychiatric disorders in youth. Methodologically strong studies show that the prevalence of anxiety disorders in children under the age of 12 years is around 5 % (see review, ). A meta-analysis on the age of onset of mental disorders found that separation anxiety disorder, specific phobia and social anxiety disorder most commonly start before the age of 15 . Early anxiety symptoms often develop into full anxiety disorders, and anxiety disorders are unlikely to remit when left untreated . Anxiety disorders negatively affect children’s quality of life and incur high societal costs [4, 5]. Furthermore, anxiety disorders frequently precede other psychiatric disorders, such as depression and substance abuse . For all these reasons, it is important to identify and treat anxious children early and successfully.
Barriers for anxious children to access help for anxiety difficulties
As much as 70 to 80% of the children with anxiety disorders does not receive treatment [7, 8]. This high percentage is strongly determined by the low accessibility and availability of anxiety treatments, which is, to a large extent, due to the limited number of qualified or specialized therapists , to the stigma associated with finding psychological help, and by geographical limitations (P. C ). It is, therefore, of importance to increase the accessibility and availability of child anxiety interventions.
Online CBT-based child anxiety interventions
A way to overcome the low accessibility and availability of child anxiety interventions is by providing online information, online assessments and offering online Cognitive Behavioral Therapy (CBT). The effect of face-to-face CBT appears to be comparable to the effect of online CBT, according to Vigerland and colleagues  and Ebert et al. . Online intervention are stand-alone to a high degree, as therapists have a limited role . Due to its highly structured character, CBT is suitable for conversion to online intervention programs .
We searched literature of published randomized controlled trials (RCT’s) on online CBT interventions and treatments for child anxiety difficulties. We excluded studies on CD-ROM based or computerized interventions and retrieved eight RCT’s in total. Of interest, not one of the eight RCT’s on online CBT in anxious children explicitly studied mediators (mechanisms of change). Moreover, moderators were only occasionally taken into account. It, thus remains uncertain how and for whom online CBT(−based interventions) for child anxiety are effective. Of these eight RCT, four focused on adolescents [15,16,17,18], one on the parents of preschoolers  and three target primary school children [20,21,22]. All three of the studies that targeted primary school children showed significant better improvement of child anxiety in the treatment condition than in the control group. We also aim at intervening via primary school children. However, in contrast to these earlier three RCT’s we do not rely strongly on active parental involvement, but, rather, focus on intervening via the children themselves.
Exposure and cognitive restructuring
Approximately 65% of children and adolescents with anxiety disorders are free of their primary anxiety disorder after CBT treatment (James, Soler, & Weatherall ;). Although this is a high percentage, it also shows that about one third of the anxious children does not benefit enough from CBT. If the working mechanisms of child CBT are understood, then scientists and clinicians can adapt and improve its content for children .
According to CBT’s theoretical model, cognitive processes determine behavior and feelings. Cognitive processes, such as thoughts, determine how someone reacts behaviorally and emotionally. In CBT, it is assumed that, through practice, one can become aware of and change dysfunctional cognitions. In turn, one can adapt his/her behavioral and emotional reactions to events (D .; K .). Anxious persons tend to overestimate the likelihood of threatening situations, while they underestimate their own cognitive and behavioral coping strategies in threatening situations . Feelings of anxiety are commonly stronger or longer-lasting than necessary and anxious children often believe they cannot adequately handle issues that scare them.
Avoidance is the most important behavioral coping strategy of anxious children (P. M [28, 29].). By avoiding, the child can escape what he/she perceives as a scary situation. If a child avoids, he/she cannot learn to handle anxious feelings nor situations that frighten him/her. Additionally, the child cannot recive information that could disconfirm is/her fearful cognitions (P. C [30, 31]). By responding in an avoidant manner to feelings of anxiety, the anxiety is maintained and can even worsen.
In order to break the vicious circle of cognitions, avoidance and feelings of anxiety, CBT and CBT-based interventions mainly focus on reducing dysfunctional cognitions (e.g. the overestimation of danger) and avoidance. Dysfunctional cognitions are targeted by cognitive restructuring. During cognitive restructuring, a child learns to detect his/her dysfunctional cognition and to replace these by a functional one. Avoidance is targeted using exposure exercises. During exposure exercises, a child exposes him−/herself to anxiety inducing stimuli.
CBT thus has a strong theoretical basis that is supported by empirical studies, convincingly demonstrating that CBT is currently an effective treatment for anxiety symptoms and anxiety disorders. To date, it is unknown whether CBT for children with anxiety actually works via decreasing dysfunctional cognitions and via decreasing avoidance. Studies on CBT’s working mechanisms in children are sparse. One of the most important prerequisites of examining working mechanisms is to establish that the outcome only changes after the active ingredients considered part of the working mechanisms has been offered . This prerequisite is seldomly complied with. To our knowledge, mediation studies on child anxiety CBT are non-existent regarding online CBT and only a few mediation studies exist in which CBT was performed in a face-to-face format (; P. C [34,35,36,37]). Of these face-to-face studies, only Hoogendoorn’s study (2014) meets the prerequisites of testing mediation . Unfortunately, avoidance behavior was not taken into consideration in Hoogendoorn’s study. Therefore, we cannot draw firm conclusions on CBT’s effect on child anxiety via alteration of cognitions and avoidance behavior, and we cannot draw any conclusions about CBT’s working mechanisms when offered in an online format.
Exposure is viewed as a fundamental part of CBT for anxiety disorders . To date, exposure therapy in children has been based on the habituation model. This model poses that success in therapy follows from reductions in expressed fear throughout exposure trials. Fear is, therefore, monitored during exposures and is seen as an indicator of successful exposure. Most commonly, a hierarchical exposure is applied for this purpose in children: children rank their feared situations and exposure takes place in stepwise (predictable) order, least feared situation first, most feared situation last. However, although exposure reduces anxiety, there is no direct evidence that this works through the mechanism proposed in the habituation model . In fact, fear reduction has been found to be non-predictive of subsequent anxiety .
Instead, inhibitory learning has been forwarded as a promising venue [38, 40, 41]. To grasp inhibitory learning, one must understand Pavlovian fear conditioning. When a neutral stimulus (conditional stimulus: CS) is repeatedly followed by an aversive stimulus (unconditional stimulus: US), in time a CS-US association is formed and the neutral stimulus will evoke an anticipatory fear reaction (conditional reaction: CR). This conditioned fear reaction can be decreased powerfully by extinction procedures, when the conditioned stimulus is repeatedly offered without the aversive stimulus (i.e. CS without US). Exposure is viewed as the clinical analogue of extinction, and inhibitory learning as extinction’s most important working mechanism. In contrast to habituation-based exposure, inhibitory learning does not specifically aim to reduce the anxiety levels of the person undergoing exposure. In fact, anxiety levels usually increase while applying inhibitory learning-based exposure. According to inhibitory learning models, an additional inhibitory association (CS – no US) is acquired in addition to the original CS-US association. Put simply, new information is learned that can override the old information. The extent to which new information can overrule the old information depends on the strength of the learning experience. Children who are at risk for developing anxiety disorders have deficits in inhibitory learning . These deficits may hinder them from optimally profiting from exposure interventions. It is, therefore, important to create optimal inhibitory learning opportunities for anxious children in interventions. Strong learning experiences, in which the expectancy of the child about the feared situation is violated clearly and explicitly are seen as optimal inhibitory learning opportunities. This is why exposure based on inhibitory learning leans strongly on variability, and not on predictable steps of increasingly difficult exposure to the feared stimuli. During exposure based on inhibitory learning, variable stimuli, variable durations, variable levels of intensity of the exercise and variable levels of anxiety provocation are applied. Some child intervention studies for anxiety related difficulties already paid attention to making the child’s expectations about the feared situation explicit and monitoring and/or evaluating the child’s expectation during and after exposure (; Philip C [43,44,45,46,47]). However, to our knowledge, no study exists that specifically applied variability in their exposure to create optimal inhibitory learning opportunities.
Children’s cognitive development
CBT was originally developed for adults. Children and adolescents have unique developmental needs that should be addressed in treatment protocols and online interventions (Paula Maria [48, 49]). In their meta-analysis, Durlak, Fuhrman & Lampman  concluded that the effect size of child CBT was almost half the size in 5–11 year old children compared to 11–13 year olds. In line, Grave and Blissett  argue that the cognitive demands of CBT suit the cognitive developmental level of children aged 11 year and older better than the cognitive developmental level of younger children. In order to test whether CBT offered to primary school children is developmentally suitable, it is thus of importance to include the child’s cognitive developmental level as a potential moderator.
Learn to dare study
The current study has five aims. First, we examine the efficacy of ‘Learn to dare!’, an online CBT program that targets anxiety without parental support and minimal therapist support. We expect that the intervention ‘Learn to Dare!’ will decrease the anxiety levels of children stronger than the anxiety levels of children in the waitlist control group. Second, we study the efficacy of exposure based on the inhibitory learning model. It is expected that exposure based on inhibitory learning will decrease child anxiety levels than the anxiety levels of children in the waitlist control group. Third, we examine whether decreases in dysfunctional cognitions and avoidance behavior are CBT’s working mechanisms. We expect that a decrease in child CBT will be mediated by decreases in dysfunctional cognitions and avoidance behavior. Fourth, the relative contribution of both proposed working mechanisms is explored. Fifth, we study whether the child’s cognitive developmental level differentially affects the proposed working mechanisms. We expect that the child’s cognitive developmental level directly affects the decrease of dysfunctional cognitions, while it does not directly affect the decrease of avoidance. In case of a high cognitive developmental level, a synergistic positive effect of the working mechanisms is expected to take place (see Fig. 1). The study design is a randomized two-group factorial design with repeated measures of the dependent variables. Intervention versus control group makes the between subjects factor and time is the only within subjects factor.
Learn to dare! Platform
Information for the participants, the screening procedure, the interventions and most assessments all take place on the ‘Learn to Dare!’ (In Dutch: ‘Leer te Durven!’) platform, https://leertedurven.ou.nl. Drupal version 7.x was our development environment, which is an Open Source Content Management System (CMS). Drupal is a web-based environment that thus runs in a browser on personal computers, and on handheld devices such as tablets and smartphones. The choice for developing in Drupal was made because of its globally organized community of developers and users and variety of well-maintained modules. On the server-side, Drupal requires Linux Apache MySql PHP (LAMP), see https://www.drupal.org/docs/7/system-requirements for more technical requirements. All missing functionality is self-written in three modules, extendable on Drupal 7 in PHP.
We have taken care of secure transfer of information, by running the ‘Learn to Dare!’ platform under the https protocol and using a separate server for the user-information database that is only accessible through our own local network by a dedicated server. Privacy is GDPD-compliant, for example, notification e-mails sent out to participants do not contain names and personal content.
We aim at recruiting children aged 8–13 years with high levels of anxiety, specific phobias or other mild anxiety disorders that are included in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5): social anxiety disorder, separation anxiety disorder, generalized anxiety disorder, panic disorder, selective mutism, agoraphobia. With mild we mean that the disorder does not strongly interfere with daily functioning, or, in other words, does not have a high severity. By performing a simulation study with 500 replications  with the package “lme4”  in R (R Core Team, 2013), we calculated how many children from this population should be included in our sample. For this simulation we assumed a medium direct effect of the training, a small effect of the indirect pathways via the mediators and 10% random drop-out between measurements. To assess the effect of the intervention, we include a waitlist control group in addition to the intervention group. In order to obtain 80% power of the direct and indirect pathways, we need a total sample size of 240 (120 children in the intervention group and 120 children in the waitlist control group). In principle, the inclusion of participants will continue until we reach this number. We exclude children with severe anxiety diagnoses, as determined by a trained clinician during a diagnostic interview. No further exclusion criteria are applied. We will recruit our participants via the community (i.e., non-clinical/ non-refferred) in the Netherlands, a list of study sites can be obtained via the first author.
This study was ethically approved by a national medical ethical review board. If important changes are made to the study protocol, the medical ethical review board will be informed about this. All data and materials of this study will be publicly accessible at osf.io/d8c4p. A detailed study design and analysis plan were preregistered at https://osf.io/g2avh. The children are recruited via online advertisements, via press releases and interviews, via social media, via free publicity in magazines and papers, via flyers we hand out at primary schools, via general practitioners and preventive mental health centers. In the online information and flyers, we refer participants to the online ‘Learn to Dare!’ platform. When visiting our platform, children and their parents find information about child anxiety and the ‘Learn to Dare!’ project. They can download separate information for young children (below 12 years) and older children (12–13 years old). See Fig. 2 for the flow diagram of this study.
Parents (and children, when they are 12 or older) send a signed informed consent form to our university, after which they receive an automatically generated e-mail with their account information. With this account, the children have access to the screening questionnaire on the platform. The authors that will be responsible for data analyses do not have access to the accounts and are completely blinded from participants’ information.
We use the Youth Anxiety Measure for DSM-5 (YAM-5, [54, 55]) as a screening tool and to measure the development of anxiety over time. When completing the YAM-5, children also fill in their demographic features. Children who score in the highest quartile are labelled as high-anxious. We use different cut-offs for boys and girls in order to increase the chance of a proportional influx of boys and girls. All other children are excluded and receive a message that they are not severely anxious, and that the program is not intended to suit their level of anxiety. These children receive links to general anxiety websites for children.
Consecutively, the high-anxious children are invited by e-mail to book a date for a diagnostic interview. The diagnostic interview Structured Clinical Interview for DSM-5 Disorders for Children (SCID, ) is performed by telephone with a trained interviewer. If the SCID shows that a child suffers from a severe anxiety disorder other than specific phobias, the child is excluded from the study. In this case, the first author does get access to the accounts of the participants (unblinding) as the parents are contacted by phone. Parents are advised by the first author to seek help for their child at a local mental health care institution.
The study concerns a randomized controlled trial (RCT). Within the ‘Learn to Dare!’ platform, the included high-anxious children are automatically randomized to the intervention group or to the waitlist control group. Children in the waitlist control group can participate in the intervention too after the last assessment point. We apply block randomization with child’s age and sex as strata. If children are randomized to the intervention group, they are assigned personal trainer who helps them during the training. The intervention and assessments are aimed at the children only.
Children in both groups perform the same assessments, which are all online within the ‘Learn to Dare!’ platform. Assessment points are aligned with the mediators, which means they take place before and after exposure and cognitive restructuring is offered to the children. At every assessment point child anxiety, avoidance behavior and dysfunctional cognitions are measured. The assessments are embedded in the intervention program, and take place after session 1 (after psycho-education and before the child’s expectancies are made explicit), after session 3 (before the start of actual exposures), after session 5 (before the start of cognitive restructuring), and at the end of the training. Control children receive automatically generated e-mails to notify them they have to complete an assessment. A follow-up assessment takes place 12 weeks after the last session. Both the intervention children and control children receive an automatically generated e-mail to notify they have to complete this assessment. At the follow-up assessment, the children take part in the diagnostic interview again. If children do not complete an assessment or intervention session, they will receive automatically generated reminders by e-mail twice. A research assistant also monitors the progress of the children and of the interviewers and trainers.
Conform ethical procedure, in case children or their parents do not want to participate in the study at any stage for any reason, they can end their participation without having to provide a reason for this. We stimulate adherence by personal e-mails or telephone calls. The research assistant ask the participants who want to discontinue the intervention, if the participant is still willing to complete the assessments, but does not enforce this on the participants. There are no criteria, other than the participant’s wishes, for discontinuation of the intervention. Under no circumstance can children participate in a different group than the one they were randomized to. Children are free to follow a different start of treatment. Those who do during the research period, are asked to report this to the research team, so we can take this into account when performing the analyses. The ethical committee decided that there is no need to compose a data monitoring committee for this study. In case a participant is harmed during the study, the first author will be unblinded from the participant’s information and will notify the ethical committee about the harmed participant.
Intervention ‘Learn to Dare!’
The intervention ‘Learn to Dare’ is based on Cognitive Behavioral Therapy. The intervention focuses on the anxious children themselves and are provided on an individual basis. Parents are informed about the intervention’s content, and are asked to motivate the child to progress through the training. Children and parents also have to agree on the rewards children receive after the exposures. Parents do not function as layman-therapists. Every child is assisted through the online program by a personal trainer, who holds a bachelor in psychology. The trainers work via a detailed protocol and write personalized messages to guide the child via private messaging (PM). Adherence is stimulated by the parents’ and trainer’s encouragement. Trainers are instructed and supervised by the first author.
The intervention takes place on the ‘Learn to Dare!’ platform, where the child has his/her own online workbook (see Fig. 3), the child is encouraged to act like a detective, studying his/her own anxieties. The detective theme is apparent throughout the intervention. The trainer has access to the child’s workbook and controls whether children can progress or not with the training by releasing new parts of the intervention. The trainer also enters information in an automated progress sheet that functions on the background of the workbook and automatically inserts individualized texts in the child’s workbook. Neither interviewers nor other researchers have access to the child’s workbook.
At the start of the intervention, the trainer has to select two domains of anxiety that are targeted in the Learn to Dare program. These anxiety domains are selected by the following method: First, the trainer checks the SCID-Junior data to see if a DSM-5 classification exists for this child. If one or two classifications apply, these are selected to be targeted in the intervention (e.g. fear of heights; social anxiety). In case of more than two classifications, specific phobias are given priority over other anxiety disorders. In case of no DSM-5 classifications, the trainer checks the YAM-5 data and picks two types of anxiety, prioritizing specific phobias. The selected anxiety domains are entered in the system and will serve as targets in the intervention. The order in which the domains are targeted is randomized within the system, which means not the trainer but the system decides which anxiety domain will be targeted with exposure and which domain with cognitive restructuring. This minimizes chances of (unwanted) manipulation of the trainer (e.g. always target specific phobias with exposure and always target generalized anxiety with cognitive restructuring).
The intervention starts off with an introduction through messages between the trainer and the participant, and then psycho-education (session 1). In accord with the inhibitory learning model, exposure (session 2 to 5, see below) takes place before cognitive restructuring (session 6 and 7, see below). Because we chose to follow the inhibitory model, we could not randomize the order of exposure or cognitive restructuring over the participants. We, therefore, chose to target two anxiety domains, one for the working mechanism exposure and one for the working mechanism cognitive restructuring, and to randomize the order in which the domains are targeted. The first anxiety domain is targeted during exposure, the second domain during cognitive restructuring. This way, the net effect of the working mechanism on the child’s anxiety can be tested most validly while following the inhibitory learning model. The intervention ends with relapse prevention and saying goodbye to the trainer (session 8). Every week, one session takes place, except when the child wants to take a break during holidays.
Exposure is set up in line with the inhibitory learning model (described in: ). To accomplish this, we made the expectancy of the child about the feared situation explicit and aimed at applying variability during the exposure sessions. During session 2, the child is asked to step in an imaginary excavator to uncover the child’s anticipated negative outcome, or the child’s expectancy, of the feared situation. Participants are also encouraged to share the worst thing that might happen when confronted with their anxiety domain. The child’s expectations about the feared situation are tested during session 3, 4 and 5. For every one of his/her five expectations, the child indicates on a VAS scale how certain he/she is that the expectation will come true. We chose five expectations, to enable variation of testing situations, while keeping the number of testing situations feasible for an online early intervention. The trainer decides in which order these expectations will be tested. In accord with inhibitory learning, the order of exposures is not hierarchical, but rather starts off with a difficult experiment, to provide the child with a strong learning opportunity. The trainer also guides the child in minimizing the use of safety behavior and safety signals. During session 3, the child watches videos of other children preparing, performing and evaluating an exposure session based on inhibitory learning. Thereafter, the child chooses five rewards (e.g. getting to choose dinner, going to the cinema with mum/dad), one for every expectation he/she will test. Next, the child makes a first tracking plan, in which the child plans an experiment in which he/she will test the first expectation. In the tracking plan, the child describes how the expectation will be tested, where the expectation will be tested and who will assist the child. The child indicates on a calendar when this experiment will take place. Then, the child actually performs the experiment and shares the experience with the trainer. This can be done by uploading a movie clip or by describing the experiment in text or audio. After the exposure session, the child reflects on what happened during the exposure and on the possible non-occurrence of the anticipated negative outcome in the online workbook. The child reflects on the aspects of the expectation that were not correct, and completes another VAS scale indicating how certain the child is about the expectation after the experiment. The evaluation enhances the consolidation of the new learned association (CS – no US). During session 4 and 5, the child will design and complete the other four tracking plans.
Cognitive restructuring takes place during session 6 and 7, focusing on the second feared situation. During session 6, the child learns to detect dysfunctional thoughts and to replace dysfunctional thoughts by functional thoughts. In session 7, the child learns to use schemes that unravel anxious events into the four elements: neutral situation, anxious thought, anxious feeling, anxious behavior. The child gets acquainted with changing the dysfunctional, anxious thought within these schemes to a helping functional though, thereby positively affecting the child’s subsequent feelings and behaviors.
The measurement tools include questionnaires, an online task and an interview. The questionnaires and the online task are embedded in the ‘Learn to Dare!’ platform, and data are automatically entered into this platform. The diagnostic interview is performed by telephone by trained bachelors in psychology, who enter the data in a separate section within the platform. The diagnostic interviewers were never involved in providing the online CBT.
The YAM-5 is a questionnaire that can be used to assess anxiety symptoms (or the anxiety level) in children and adolescents. This study focused on the child self-report version. The YAM-5 consists of two parts. Part I (28 items) taps symptoms of the major DSM-5 anxiety disorders, and thus contains the following subscales: separation anxiety disorder (6 items, e.g., I am afraid to go anywhere without my parents), selective mutism (4 items, e.g., At school, I don’t speak to the teacher at all), social anxiety disorder (6 items, e.g., I find it scary to meet new people), panic disorder (6 items, e.g., I panic for no reason), and generalized anxiety disorder (6 items, e.g., I worry about a lot of things). Part II (22 items) also contains 5 subscales covering the phobia types: animal (5 items, e.g., I am afraid of wasps), natural environment (4 items, e.g., I am afraid of the dark), blood-injection-injury (3 items, e.g., I am afraid of undergoing a small medical operation), other (4 items, e.g., I am afraid of people who are dressed up in costumes), and situational, which, in terms of fear content resembles agoraphobia (6 items, e.g., I am afraid when crossing a large town square). All items are rated on a 4-point Likert scale, ranging from 0 (never) to 3 (always). Good internal consistencies were demonstrated for the subscales of Part I and for the total scale of Part I and Part II. Furthermore, good test-retest reliability, good concurrent validity and good construct validity of both parts of the questionnaire were found.
Structured clinical interview for DSM-5 disorders for children (SCID, )
The SCID-junior is a structured clinical interview to assess the most common DSM-5 disorders in childhood, including all anxiety disorders. It is a DSM-5 modification of the Kid-SCID , a widely used interview for assessing DSM-IV childhood mental disorders that has moderate to good interrater reliability and internal consistency [58, 59]. The DSM-5 criteria for each disorder can be checked by a clinician, separately with the child, the parent(s), and other informants such as teachers, after which the clinician makes a “best judgment”.
Children’s automatic thoughts scale-negative/positive (CATS-N/P)
The CATS-N/P  is an extension of the CATS  and assesses negative (or: dysfunctional cognitions, DL’s) as well as positive thoughts in children. All of the items are scored on a 5-point scale, ranging from 0 (not at all) to 4 (all the time). The CATS contained the scales Physical Threat, Social Threat, and Personal Failure that measured negative thoughts. These subscales contain 30 items in total that can be added to form a sumscore, where higher scores reflect more negative thoughts. Positive thoughts are measured with the subscale Positive Thoughts that includes 10 items. These 10 items can also be added to form a subscore, with higher scores reflecting more positive thoughts. Hoogendoorn (2010) revealed good psychometric properties of the CATS-N/P, with total Cronbach’s alpha ranging between .90 and .96 for the total score and between .84 and .93 for the Positive Thoughts subscale.
Child avoidance measure self-report (CAMS, )
The CAMS contains eight items measuring a child’s tendency to avoid stimuli that elicit anxiety, fear, or worry (or: avoidance behavior, AB). The questionnaire presents a stem statement (When I feel scared or worried about something …) and the items covering various approaches to avoiding anxiety provoking stimuli, through passive and active avoidance, as well as refusal, (e.g., I try not to go near it). Items are rated on a Likert-type scale from Almost Never to Almost Always). The CAMS has good internal and test-retest reliability, concurrent and criterion validity, and treatment sensitivity. For the current study, the CAMS was translated to Dutch via a translate and back-translate procedure. One of the subgoals of this study is to psychometrically validate the Dutch version of the CAMS.
Child’s level of abstract reasoning
We measure the level of the children’s abstract reasoning skills to get an indication of the level of cognitive level (CL). We developed the abstract reasoning task ourselves to enable implementation in our online platform and enable a non-invasive adaptation specifically for our age group. Our abstract reasoning task is based on other freely available online abstract reasoning tasks and on the abstract reasoning task of the Matrix Reasoning of the fifth version Wechsler Intelligence Scale for Children (WISC-V, ). There are 10 tasks in which the child sees an array of abstract forms with one missing form. The child then has to select the correct form out of four alternatives.
Both the Statistical Packages for Social Sciences (SPSS, version 24) and R (R. C. Team, 2013) will be employed for performing the analyses. Multilevel analysis  is used to answer the various sub-questions. The study design is a randomized two-group factorial design with repeated measures of the dependent variables. Intervention versus control group makes the between subjects factor and time is the only within subjects factor. Alternatively, the design can be seen as a randomized two-group multilevel design with repeated measurements nested within subjects. The sub-questions correspond with different parameters to be estimated in the statistical model. The model can be seen as a moderated mediation  model in which the effect of the training is on the one hand by reducing dysfunctional cognitions and on the other hand by reducing avoidance. In addition, the path depends on the level of development of the child by reducing dysfunctional cognitions (see Fig. 1).
To test the primary research question, we will use regression model with the outcome Anxiety Level (AL) as dependent variable and condition (LTD vs WL) as predictor. Sex and Age will be added as extra predictors, plus interactions between predictors to see if the effects differ per sex and age category (LC). Model: AL = b0 + b1*Group + b2*Sex + b3*LC + b4*Group*Sex + b5*Condition*LC. To test the moderation and mediation models, we will use multilevel analysis . The five assessments (T1,T2,T3,T4,T5) will be the lowest level, the children the second level. This model can be considered a moderated mediation model (Hayes, 2013). The mediation analysis will consist of 2 steps. 1st: Dysfunctional Cognitions (DC) and Avoidance Behavior (AB) will be dependent variables, in separate analyses. 2nd: Anxiety level (AL) will be the dependent variable. Time will be added and modelled as T = 0,1,2,3,4, to tested the linear increase of Anxiety Level (AL) during the intervention. We will use a random intercept model, because we expect individual differences to exist in the levels of DC, AB, AL. Step 1. DC = b0 + b1*Group + b2*Time VG = b0 + b1*Group + b2*Time. Step2. AL = b0 + b1*Group + b2*VG + b3*DC. To test the third hypothesis (moderation by cognitive level), we will perform a multilevel analysis as above. 1st: Dysfunctional Cognitions (DC) and Avoidance Behavior (AB) will be dependent variables, in separate analyses. Cognitive Level (CL) will be added as predictor in a hierarchical linear multilevel model, including the interaction with condition to test for the moderating effect of CL on the relation between condition and mediators. Time will be added and modelled as T = 0,1,2,3,4, to tested the linear increase of DC and AB during the intervention. We will use a random intercept model, because we expect individual differences to exist in the levels of DC and AB. DC = b0 + b1*Group + b2*CL + b3*Group*CL + b4*Time VG = b0 + b1*Group + b2*CL + b3*Group*CL + b4*Time. The variable Cognitive Level (CL) will be centered at zero. For the follow-ups, when interaction effects appear to be significant, simple slopes plots will be made to illustrate the interaction effect. The 95% confidence interval of the parameter estimates of the multilevel and logistic regression analyses will be used to assess the statistical and practical significance of the estimates. The standardized parameter estimates will be used as estimated effect sizes. For all interval variables univariate outlier detection will be applied by using the Inter Quartile Range (IQR): scores outside 1.5*IQR will be examined, in order to see whether these are genuine scores, and cannot be attributed to coding or other errors. If they are genuine the scores remain in the analysis, otherwise they are removed from the analysis. Since we will use multilevel analyses drop-outs can be kept in the analysis. Subjects with at least one wave (time point) with complete data will be used in the analysis. No imputation strategy will be applied. We will explore the time factor in more detail. Other coding schemes than a simple linear coding will be tested to see whether effect gradually weaken in time or take effect after a certain period. Furthermore, we will explore whether the proposed model has predictive value for the binary outcome (anxiety diagnosis).
Offering easy accessible interventions and providing insight into the working mechanisms of Cognitive Behavioral Therapy will contribute to optimizing Cognitive Behavioral Therapy for anxious youth.
Availability of data and materials
A detailed study design and analysis plan were preregistered at https://osf.io/g2avh, supporting data can be accessed via this register in the Open Science Framework.
Children’s Automatic Thoughts Scale – Negative/Positive
Cognitive Behavioral Therapy
Content Management System
Diagnostic and Statistical Manual of Mental Disorders
Inter Quartile Range
Linux Apache MysqlPHP
Learn to Dare
Randomized Controlled Trial
Structured Clinical Interview for DSM-5 Disorders for children
Youth Anxiety Measure for DSM-5
Cartwright-Hatton S, McNicol K, Doubleday E. Anxiety in a neglected population: prevalence of anxiety disorders in pre-adolescent children. Clin Psychol Rev. 2006;26(7):817–33.
de Lijster JM, Dierckx B, Utens EM, Verhulst FC, Zieldorff C, Dieleman GC, Legerstee JS. The age of onset of anxiety disorders: a meta-analysis. Can J Psychiatry. 2017;62(4):237.
Simon E, van der Sluis C, Muris P, Thompson E, Cartwright-Hatton S. Anxiety in preadolescent children: what happens if we don't treat it, and what happens if we do? Psychopathol Rev. 2014;1(1):28–50.
Achenbach TM, Howell CT, McConaughy SH, Stanger C. Six-year predictors of problems in a national sample of children and youth: I. cross-informant syndromes. J Am Acad Child Adolesc Psychiatry. 1995;34(3):336–47.
Bodden DH, Dirksen CD, Bögels SM. Societal burden of clinically anxious youth referred for treatment: a cost-of-illness study. J Abnorm Child Psychol. 2008;36(4):487–97.
Pine DS, Cohen P, Gurley D, Brook J, Ma Y. The risk for early-adulthood anxiety and depressive disorders in adolescents with anxiety and depressive disorders. Arch Gen Psychiatry. 1998;55(1):56–64.
Chavira DA, Stein MB, Bailey K, Stein MT. Child anxiety in primary care: prevalent but untreated. Depression and anxiety. 2004;20(4):155–64.
Essau CA, Conradt J, Petermann F. Course and outcome of anxiety disorders in adolescents. J Anxiety Disord. 2002;16:67–81. https://doi.org/10.1016/S0887-6185(01)00091-3.
Weisz JR, Hawley K, Jensen-Doss A. Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child Adolesc Psychiatr Clin N Am. 2004;13:729–815.
Kendall PC, Khanna MS, Edson A, Cummings C, Harris MS. Computers and psychosocial treatment for child anxiety: recent advances and ongoing efforts. Depression Anxiety. 2011;28:58–66. https://doi.org/10.1002/da.20757.
Vigerland S, Lenhard F, Bonnert M, Lalouni M, Hedman E, Ahlen J, Ljotsson B. Internet-delivered cognitive behavior therapy for children and adolescents: a systematic review and meta-analysis. Clin Psychol Rev. 2016a;50:1–10.
Ebert DD, Zarski A-C, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, Riper H. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895.
Rooksby M, Elouafkaoui P, Humphris G, Clarkson J, Freeman R. Internet-assisted delivery of cognitive behavioural therapy (CBT) for childhood anxiety: systematic review and meta-analysis. J Anxiety Disord. 2015;29:83–92. https://doi.org/10.1016/j.janxdis.2014.11.006.
Anderson P, Jacobs C, Rothbaum BO. Computer-supported cognitive-behavioral treatment of anxiety disorders. J Clin Psychol. 2004;27:459–68. https://doi.org/10.1186/2046-4053-2-88.
Calear AL, Christensen H, Mackinnon A, Griffiths KM, O'Kearney R. The YouthMood project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol. 2009;77(6):1021.
Hoek W, Schuurmans J, Koot HM, Cuijpers P. Effects of internet-based guided self-help problem-solving therapy for adolescents with depression and anxiety: a randomized controlled trial. PLoS One. 2012;7(8):e43485.
Spence SH, Donovan CL, March S, Gamble A, Anderson RE, Prosser S, Kenardy J. A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. J Consult Clin Psychol. 2011;79(5):629.
Tillfors M, Andersson G, Ekselius L, Furmark T, Lewenhaupt S, Karlsson A, Carlbring P. A randomized trial of internet-delivered treatment for social anxiety disorder in high school students. Cogn Behav Ther. 2011;40(2):147–57.
Donovan CL, March S. Online CBT for preschool anxiety disorders: a randomised control trial. Behav Res Ther. 2014;58:24–35.
March S, Spence SH, Donovan CL. The efficacy of an internet-based cognitive-behavioral therapy intervention for child anxiety disorders. J Pediatr Psychol. 2008;34(5):474–87.
Spence SH, Holmes JM, March S, Lipp OV. The feasibility and outcome of clinic plus internet delivery of cognitive-behavior therapy for childhood anxiety. J Consult Clin Psychol. 2006;74(3):614.
Vigerland S, Ljótsson B, Thulin U, Öst L-G, Andersson G, Serlachius E. Internet-delivered cognitive behavioural therapy for children with anxiety disorders: a randomised controlled trial. Behav Res Ther. 2016b;76:47–56.
Silverman WK, Pina AA, Viswesvaran C. Evidence based psychosocial treatments for phobic and anxiety disorders in children and adolescents. J Clin Child Adolesc Psychol. 2008;37:105–30.
Kazdin AE. Developing a research agenda for child and adolescent psychotherapy. Arch Gen Psychiatry. 2000;57:829–35.
Dobson D, Dobson KS. Evidenced-based practice of cognitive-behavioral therapy. New York: Guilford; 2009.
Dobson K, Dozois D. Historical and philosophical basis of cognitive-behavioral therapy. In: Dobson K, editor. Handbook of cognitive-behavioral therapies. New York: Guilford; 2001. p. 3–39.
Beck AT. The current state of cognitive therapy- a 40-year retrospective. Arch Gen Psychiatry. 2005;62:953–9.
Barrett PM, Rapee RM, Dadds MR, Ryan SM. Family enhancement of cognitive style in anxious and aggressive children: threat bias and the FEAR effect. J Abnorm Child Psychol. 1996;24:187–203.
Chorpita BF, Albano AM, Barlow DH. Cognitive processing in children: relationship to anxiety and family influences. J Clin Child Psychol. 1996;25:170–6.
Kendall PC, Chu BC, Pimentel S, Choudbury M. Treating anxiety disorders in youth. In: Kendall PC, editor. Child and adolescent therapy: cognitive-behavioral procedures. New York: Guilford Press; 2000. p. 235–87.
Vasey MW, Dadds MR. An introduction to the developmental psychopathology of anxiety. In: Vasey MW, Dadds MR, editors. The developmental psychopathology of anxiety. New York: Oxford University Press; 2001.
Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.
Alfano CA, Pina AA, Villalta IK, Beidel DC, Ammerman RT, Crosby LE. Mediators and moderators of outcome in the behavioral treatment of childhood social phobia. J Am Acad Child Adolesc Psychiatry. 2009;48:945–53. https://doi.org/10.1097/CHI.0b013e3181af8216.
Kendall PC, Treadwell KRH. The role of selfstatements as a mediator in treatment for youth with anxiety disorders. J Consulting Clin Psychol. 2007;75:380–9. https://doi.org/10.1037/0022-006X.75.3.380.
Lau WY, Chan CKY, Li JCH, Au TKF. Effectiveness of group cognitive-behavioral treatment for childhood anxiety in community clinics. Behav Res Ther. 2010;48:1067–77. https://doi.org/10.1016/j.brat.2010.07.007.
Maric M, Heyne DA, MacKinnon DP, Van Widenfelt BM, Westenberg PM. Cognitive mediation of cognitive behavioural therapy outcomes for anxiety-based school refusal. Behav Cogn Psychother Behavior genetics; 2012. https://doi.org/10.1017/S1352465812000756.
Treadwell KRH, Kendall PC. Self-talk in youth with anxiety disorders: states of mind, content specificity, and treatment outcome. J Consult Clin Psychol. 1996;64:941–50. https://doi.org/10.1037/0022-006X.64.5.941.
Vervliet B, Depreeuw B, Treanor M, Conway CC, Zbozinek T, Craske MG. Exposuretherapie maximaliseren. Een benadering volgens het inhibitorisch-leermodel. Gedragstherapie. 2014;47(4):296–339.
Craske MG, Treanor M, Conway CC, Zbozinek T, Vervliet B. Maximizing exposure therapy: an inhibitory learning approach. Behav Res Ther. 2014;58:10–23.
Craske MG, Kircanski K, Zelikowsky M, Mystkowski J, Chowdhury N, Baker A. Optimizing inhibitory learning during exposure therapy. Behav Res Ther. 2008;46(1):5–27.
Craske MG, Liao B, Brown L, Vervliet B. Role of inhibition in exposure therapy. J Exp Psychopathol. 2012;3(3):322–45.
Chu BC, Colognori DB, Yang G, Xie M-G, Bergman RL, Piacentini J. Mediators of exposure therapy for youth obsessive-compulsive disorder: specificity and temporal sequence of client and treatment factors. Behav Ther. 2015;46(3):395–408.
Kendall PC, Flannery-Schroeder E, Panichelli-Mindel SM, Southam-Gerow M, Henin A, Warman M. Therapy for youths with anxiety disorders: a second randomized clincal trial. J Consult Clin Psychol. 1997;65(3):366.
Nixon RDV, Sterk J, Pearce A. A randomized trial of cognitive behaviour therapy and cognitive therapy for children with posttraumatic stress disorder following single-incident trauma. J Abnorm Child Psychol. 2012;40(3):327–37.
Peris TS, Compton SN, Kendall PC, Birmaher B, Sherrill J, March J, McCracken JT. Trajectories of change in youth anxiety during cognitive—behavior therapy. J Consult Clin Psychol. 2015;83(2):239.
Whiteside SP, Ale CM, Young B, Dammann JE, Tiede MS, Biggs BK. The feasibility of improving CBT for childhood anxiety disorders through a dismantling study. Behav Res Ther. 2015;73:83–9.
Wood JJ, Ehrenreich-May J, Alessandri M, Fujii C, Renno P, Laugeson E, Lewin AB. Cognitive behavioral therapy for early adolescents with autism spectrum disorders a clinical anxiety: a randomized, controlled trial. Behav Ther. 2015;46(1):7–19.
Barrett PM. Treatment of childhood anxiety: developmental aspects. Clin Psychol Rev. 2000;20(4):479–94.
Piacentini J, Bergman RL. Developmental issues in cognitive therapy for childhood anxiety disorders. J Cogn Psychother. 2001;15(3):165.
Durlak JA, Fuhrman T, Lampman C. Effectiveness of cognitive-behavior therapy for maladapting children: a meta-analysis. Psychol Bull. 1991;110(2):204.
Grave J, Blissett J. Is cognitive behavior therapy developmentally appropriate for young children? A critical review of the evidence. Clin Psychol Rev. 2004;24(4):399–420.
Hedeker D, Gibbons RD, Waternaux C. Sample size estimation for longitudinal designs with attrition: comparing time-related contrasts between two groups. J Educ Behav Stat. 1999;24:70–93.
Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. arXiv preprint arXiv. 2014;1406:5823.
Muris P, Simon E, Lijphart H, Bos A, Hale W, Schmeitz K. The youth anxiety measure for DSM-5 (YAM-5): development and first psychometric evidence of a new scale for assessing anxiety disorders symptoms of children and adolescents. Child Psychiatry Hum Dev. 2017;48(1):1–17.
Simon E, Bos AE, Verboon P, Smeekens S, Muris P. Psychometric properties of the youth anxiety measure for DSM-5 (YAM-5) in a community sample. Personal Individ Differ. 2017;116:258–64.
Braet C, Wante L, Bögels SM, Roelofs J. SCID-junior: structured clinical interview for DSM-5 disorder for children. Amsterdam: Boom; in press.
Hien D, Matzner F, First M, Spitzer R, Williams J, Gibbon M. Structured clinical interview for DSM-IV childhood diagnoses (KID-SCID). New York: Biometrics Research; 1998.
Roelofs J, Muris P, Braet C, Arntz A, Beelen I. The structured clinical interview for DSM-IV childhood diagnoses (kid-SCID): First psychometric evaluation in a Dutch sample of clinically referred youths. Child Psychiatry Hum Dev. 2015;46:367–75.
Van Vlierberghe L, Braet C, Goossens L, Mels S. Psychiatric disorders and symptom severity in referred versus nonreferred overweight children and adolescents. Eur Child Adolesc Psychiatry. 2008;18:164–73.
Hoogendoorn SM, Wolters LH, Vervoort L, Prins PJ, Boer F, Kooij E, De Haan E. Measuring negative and positive thoughts in children: an adaptation of the Children’s automatic thoughts scale (CATS). Cogn Ther Res. 2010;34(5):467–78.
Schniering CA, Rapee RM. Development and validation of a measure of children’s automatic thoughts: the children’s automatic thoughts scale. Behav Res Ther. 2002;40:1091–109.
Whiteside SP, Gryczkowski M, Ale CM, Brown-Jacobsen AM, McCarthy DM. Development of child-and parent-report measures of behavioral avoidance related to childhood anxiety disorders. Behav Ther. 2013;44(2):325–37.
Wechsler D. Wechsler intelligence scale for children–fifth edition (WISC-V). Bloomington: Pearson; 2014.
Raudenbush SW, Bryk AS. Hierarchical linear models: Applications and data analysis methods (Vol. 1). Thousand Oaks: Sage; 2002.
Hayes AF, Scharkow M. The relative trustworthiness of inferential tests of the indirect effect in statistical mediation analysis: does method really matter? Psychol Sci. 2013;24(10):1918–27.
Hoogendoorn SM, Prins PJ, Boer F, Vervoort L, Wolters LH, Moorlag H, et al. Mediators of cognitive behavioral therapy for anxiety-disordered children and adolescents: cognition, perceived control, and coping. J Clin Child Adolesc Psychol. 2014;43(3):486–500.
James AACJ, Soler A, Weatherall R. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2005;4:1–35.
Team, R. C. A language and environment for statistical computing. Paper presented at the The R Foundation for Statistical Computing. Vienne; 2013a.
Team, R. C. R: A language and environment for statistical computing. Paper presented at the R Foundation for statistical computing. Vienna; 2013b. http://www.R-project.org/
We acknowledge the contribution of all the participants in the study.
E. (Corresponding author): This author made a substantial contribution to the conception and design of the work and to the acquisition of participants.
E. D.: This author made a substantial contribution to the conception and design of the work, and has drafted and revised the work substantively.
S. M.: This author made a substantial contribution to the conception of the work, and has revised the work substantively.
P.: This author made a substantial contribution to the conception, design and analyses of the work, and has drafted the work substantively.
P. M.: This author made a substantial contribution to the design of the work, and has drafted the work substantively.
D. J. A. W.: This author made a substantial contribution to the design of the work, and has drafted the work substantively.
W.: This author made a substantial contribution to the design of the work, and to the creation of new software used in the work.
M.: This author made a substantial contribution to the conception of the work, and has drafted the work substantively.
S.: This author made a substantial contribution to the conception of the work, and has drafted the work substantively.
J.: This author made a substantial contribution to the conception and design of the work, and has drafted and revised the work substantively.
We have retrieved funding for our project from Mind Netherlands, nr. 2015 7025, address: Stationsplein 125, 3818 LE Amersfoort, Netherlands. The funding body approved the design of the study, but does not play an active role in the analysis and interpretation of the data, nor in writing the manuscripts. The protocol has been peer-reviewed by the funding body.
Ethics approval and consent to participate
Our research is performed in accordance with the Declaration of Helsinki. It has been approved by a national ethical committee in the Netherlands, i.e., the METC asM/UM, reference number: NL 60801.068.17 / METC 173019. Furthermore, we obtain written informed consent to participate in the study from participants. More specific: All parents complete written informed consents for their children and children also complete written informed consents if they are 12 years or older.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Simon, E., de Hullu, E., Bögels, S. et al. Development of ‘learn to dare!’: An online assessment and intervention platform for anxious children. BMC Psychiatry 20, 60 (2020). https://doi.org/10.1186/s12888-020-2462-3
- Child anxiety
- Online intervention
- Early intervention
- Inhibitory learning