Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Psychometric properties and factor structure of the Korean version of the screen for child anxiety related emotional disorders (SCARED)

BMC Psychiatry volume 20, Article number: 89 (2020) Cite this article

Abstract

Background

The aim of this study was to examine the psychometric properties of the Korean version of Screen for Child Anxiety Related Emotional Disorders (SCARED) on a sample of Korean youths and to examine the cross-cultural differences in adolescents’ anxiety.

Methods

Our study included 147 adolescents (ages 12–17, 92 girls), 93 with major depressive disorder and 54 as controls. Participants were evaluated using the Kiddie-Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL), SCARED, Child Behavior Checklist (CBCL), Disruptive Behavioral Disorder Scale (DBD) and Attention Deficit Hyperactivity Disorder Rating Scale (ADHD-RS). Pearson’s r and Cronbach’s α values of the SCARED were calculated, and exploratory factor analysis was conducted.

Results

The Korean SCARED scores were correlated with the total anxiety scores of K-SADS-PL (r = 0.74) and the CBCL anxious/depressed subscale scores (r = 0.35). Results showed a five-factor structure with good internal consistency, in which some items were loaded on different factors compared to previous studies.

Conclusions

The Korean SCARED demonstrated promising psychometric properties, and could be a valid scale for screening anxiety symptoms in primary care. The fact that different items comprised the factors may reflect the cultural difference between United States and Korea in experiencing anxiety.

Peer Review reports

Background

Anxiety disorders are the most prevalent psychiatric disorders in children and adolescents worldwide. In the United States, the point prevalence rate of adolescents’ anxiety disorders based on DSM-IV diagnosis was 15% and the 12-month prevalence rate was as high as 25% [1]. In Korean children and adolescents aged 6 to 18, the one-year prevalence rate of anxiety disorder was 11.7% [2]. Another study of Korean children aged 6 to 12 showed that the past-year prevalence of anxiety disorders was 10.3% [3]. Despite these high prevalence rates, anxiety disorders are often underdiagnosed and remain untreated for the following reasons: first, they are not as evident as behavioral disorders [4]; second, they are frequently comorbid with other psychiatric disorders that gain more clinical attention, such as depressive disorders and substance abuse [5, 6].

In South Korea, there is a cultural emphasis on academic achievement [7], which creates an excessive academic burden, an overly competitive atmosphere, and university entrance-oriented education [8, 9]. As a result, adolescents’ anxiety and depression tend to increase as the grade level increases in schools [8,9,10]. According to a report by the Korean National Youth Policy Institute, 20.9% of Korean youth have thought about committing suicide in one year mainly due to academic stress and anxiety [11]. Anxiety is known to be an important predictive factor for suicidality [10]. Thus, early detection and intervention of Korean youths’ anxiety disorders are important, considering the severity and consequences of these disorders.

Both the Korean versions of the State-Trait Anxiety Inventory (STAIC) and the Revised Children’s Manifest Anxiety Scale (RCMAS) measure youth anxiety. The STAIC and RCMAS are used to evaluate anxiety in various aspects. The STAIC includes both the state and trait scales. While the state scale measures the current feeling of anxiety, the trait scale measures a more stable and pervasive tendency to experience anxiety. The three subscales of RCMAS assess worry/oversensitivity, fear/concentration, and physiological anxiety. Although the STAIC and RCMAS measure general anxiety symptoms, both have limitations. First, they do not provide information regarding specific anxiety disorders. Second, they have some limitations regarding discriminant validity such that they did not distinguish definitely anxiety disorders from behavioral disorders such as ADHD [12].

The Screen for Child Anxiety Related Emotional Disorders (SCARED) is a screening questionnaire for anxiety disorders in youth. It is a rating scale completed by children or parents. Although it has been used in some clinical studies conducted in Korea [13, 14], the psychometric properties of the Korean version are yet to be determined. The scale has several advantages compared to other anxiety scales mentioned above. First, the SCARED can assess specific anxiety disorders in addition to assessing general anxiety symptoms. Second, it can be applied to a wider age range of youth, from 6 to 19 years [15, 16], compared to the STAIC, which is indicated for youth ages 9–12. Third, the English SCARED shows good psychometric properties, specifically in terms of discriminant validity, and can differentiate children with an anxiety disorder from depression or disruptive disorder-only groups [17]. Internal consistency and factor structure were also shown to be robust when applied to different cultures and races, including European countries, South Africa, China, non-Hispanic White and African Americans, and Arabia [18, 19]. In addition, the SCARED is a self-report measure, which is more practical compared to diagnostic clinical interviews [20]. Given such advantages of the SCARED, it is meaningful to examine the psychometric properties of the Korean version of the SCARED to assist better diagnosis and treatment of anxiety disorders in Korean youth.

Due to an historical background of Confucianism, there exists a strong sense of community in South Korea [21, 22]. Children are often brought up to be considerate of others and to be attentive to how they are viewed by others, a character that is called ‘Nun-chi’ in Korean [22, 23]. In social atmospheres as seen in Korea and Japan, there is a culture-specific social fear regarding concern at offending others, called ‘Taein Kongpo’ in Korean, or ‘Taijin Kyofusho’ in Japanese [24, 25]. In a study of Korean middle and high school students, 13% of middle school students and 14.8% of high school students thought that they would cause harm to others because of their social anxiety [23]. Children and adolescents’ excessive social anxiety cause difficulties in peer relationships and academic ability, school refusal, abandonment of school activities, and deterioration of their psychosocial functions [26, 27]. Due to the cultural specificity of Korea, it is possible that the factor structure of the Korean version of the SCARED might differ from that of the English SCARED.

In this study, we aimed to establish the reliability and validity of the Korean SCARED and investigated the factor structure of the scale. We hypothesized that the Korean SCARED would be a valid and reliable scale to assess anxiety symptoms in Korean youth. In addition, we hypothesized that the cross-cultural differences in experiencing social anxiety would be reflected in the factor structure of the Korean SCARED.

Methods

Participants

Our study included 95 depressed participants between the ages of 12–17 years. They were part of a study that investigated the biomarkers of the antidepressant response and suicidal events in depressed youth (NRF-2015R1A2A2A01004501). Major depressive disorder (MDD) diagnoses were made using the Kiddie-Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL) [7, 28, 29], which is based on Diagnostic and Statistical Manual of Mental Disorders-5th Edition (DSM-5) [30] criteria. The participants were recruited from the child and adolescent psychiatric outpatient clinic at the Seoul National University Hospital between August 2015 and June 2018.

Participants were included in the study if they were diagnosed with MDD, had symptoms lasting for at least 4 weeks or more without psychotic features, scored 40 or higher on the Children’s Depression Rating Scale-Revised (CDRS-R) [31], and scored 4 or higher points on the Clinical Global Impression-Severity scale [32]. Exclusion criteria were intelligence quotient (IQ) under 70, a history of chronic medical and neurological diseases, diagnosis of psychotic disorders such as schizophrenia, diagnosis of bipolar disorders and developmental disorders such as autism, substance abuse within the past 6 months, a diagnosis of bipolar I disorder among immediate relatives, and taking any psychiatric medication. Totally, 57 healthy controls were recruited via school flyers. They visited our clinic and were initially screened using the K-SADS-PL.

Among the initially recruited 152 subjects, 2 depressed participants and 3 healthy controls withdrew their participation consent and therefore were excluded from the study. Thus, a total of 147 subjects (92 of which were girls) were included in the analyses; these were divided into depression and anxiety comorbid (n = 44), depression only (n = 49) and control (n = 54) groups based on the psychiatric diagnoses from the K-SADS-PL.

The study was approved by the Institutional Review Board for Human Subjects of Seoul National University Hospital. All the parents and youth were provided with detailed information about the study. Written informed consent was obtained from all participants before entering the study.

Assessments

At baseline, all participants were assessed using the K-SADS-PL, SCARED, Child Behavior Checklist (CBCL), Disruptive Behavioral Disorder Scale (DBD) and ADHD Rating Scale (ADHD-RS).

The SCARED is a 41-item self-report that screens for anxiety disorders and can be completed by child and parent. In our study, the SCARED child version was used. In a validation study of the Korean SCARED, the researcher team translated the original SCARED items into Korean, back-translated them to English by a bilingual researcher, and re-checked the back-translated version. Finally, the scale was confirmed by a researcher with Ph.D. in clinical psychology [33].

During assessment, a psychiatrist (J.-W.K) who was blind to the SCARED scores administered the K-SADS-PL to the participants and their parents. To investigate the correlation between the SCARED and K-SADS-PL anxiety symptoms, we calculated a total score by adding up the following subscale scores as per screen section: panic disorder (1 item), separation anxiety disorder (5 items), social phobia (2 items) and generalized anxiety disorder (4 items).

Parents completed the CBCL, DBD, and ADHD-RS. The CBCL is a 113-item scale measuring six DSM oriented scales- affective, anxiety, ADHD, conduct, oppositional defiant disorder (ODD), and somatic problems [34]. In our study, we used the anxious/depressed subscale, internalizing and externalizing scales of CBCL. The DBD is a 41-item scale used to measure ADHD (18 items), ODD (8 items) and conduct disorder (CD) (15 items) symptoms [35, 36]. In our study, we used the CD subscale to assess behavioral symptoms only. The ODD subscale also shows behavioral symptoms, however, they might not be prominent to the parents if the behavioral problems are only confined to the school or outside the home. Thus, we selected CD subscale, which would be more evident to parents. Each item is rated on a 4-point Likert scale. The ADHD-RS is an 18-item self-report used to screen for ADHD [37]. The scale measures two features of ADHD: inattention and hyperactivity-impulsivity. Each item is rated on a 4-point Likert scale. The ADHD-RS is known to specifically evaluate ADHD symptoms, which can be used to screen, diagnose, and evaluate the effect of treatment for ADHD [37]. For this reason, we chose the ADHD-RS over the ADHD subscales of the CBCL and the DBD.

Statistical analyses

Demographic variables were analyzed using ANOVA or Chi-square tests. To examine the criterion and discriminant validity of the SCARED, Pearson’s correlation coefficients were measured. ANOVA was used to compare the clinical variables among anxiety + depression (A + D), depression only (D only) and control groups. A Tukey’s honest significance test or Dunnett T3, depending on whether the equality of variances was met or not, was done as a post hoc analysis, to examine the differences in the Korean SCARED total and subscale scores among A + D, D only and control groups.

Our sample size satisfied the minimum required sample size for a factor analysis [38], which allowed us to conduct factor analysis to investigate the factor structure of the Korean SCARED. Since the data was not normally distributed [39], principal axis factoring was used to extract factors. Scree test was used to decide the number of factors. Lastly, promax rotation, a method used for analyzing correlated factors [39], was performed to determine the factor structure. All primary data were analyzed with SPSS version 22.0.

Finally, a sensitivity analysis was conducted to assess the robustness and reproducibility of the factor structure we elicited, using an independent dataset. From the ‘Validation of depression-related scales in child and adolescent psychiatric outpatients’ study (IRB No. 1908–088-1055), the sample consisted of 464 participants (278 of whom were girls) aged 7 to 19, recruited from the child and adolescent psychiatric outpatient clinic of Seoul National University Hospital between August 2015 and July 2019. Inclusion criteria were to have completed a semi-structured interview and the same questionnaires as mentioned above in the Assessment section for the intake assessment. Demographic and clinical data were collected in the same manner. Among the sample, subjects included in the primary factor analyses were excluded. After applying the inclusion and exclusion criteria, the sample consisted of 431 participants (257 of whom were girls) aged 7 to 19. Among them, 262 were diagnosed with MDD, 49 with bipolar disorder, 69 with anxiety disorder, 11 with ADHD, 5 with conduct disorder, 2 with tic disorder, 3 with autism, and 29 with eating disorder. One participant had no psychiatric disorder. Confirmatory factor analysis (CFA) using the maximum-likelihood method was performed on the independent dataset. CFA was conducted with R version 1.2.5019, Lavaan package and internal consistencies were calculated with SPSS version 22.0.

Results

Demographics and clinical characteristics

No significant difference was found in age, gender and IQ between the A + D, D only, and control groups. However, there were significant differences between three groups in scores on the Korean SCARED, CBCL internalizing scales and the K-SADS-PL anxiety subscale. Post hoc analyses revealed that CBCL anxious/depressed, CBCL externalizing scales, ADHD and CD scores differed significantly between the D only and control groups, but not between the A + D and D only groups (Table 1).

Table 1 Demographic and clinical characteristics of primary dataset
Full size table

Criterion validity

As shown in Table 2, the Korean SCARED showed significant correlation with the K-SADS-PL anxiety subscale total scores (r = 0.74, p < 0.001). We calculated a total score of the K-SADS-PL anxiety subscales by summing up panic disorder (PD), Separation Anxiety Disorder (SAD), social phobia (SP), and generalized anxiety disorder (GAD) subscale scores. The Korean SCARED scores were correlated with all K-SADS-PL anxiety subscales (rs > 0.214, p-values ≤0.009), of which the GAD subscale (r = 0.75, p < 0.001) showed the strongest correlation.

Table 2 Correlations among SCARED, CBCL_anx/dep, CBCL_int, CBCL_ext, CD and ADHD
Full size table

The Korean SCARED and CBCL anxious/depressed subscale also showed significant correlation, although it was relatively low (r = 0.35, p < 0.001).

Discriminant validity

The correlation between the Korean SCARED and the externalizing problem of CBCL was not significant (r = 0.13, p = 0.14). On the contrary, the Korean SCARED and the internalizing problem of CBCL showed moderate correlation (r = 0.57, p < 0.001). The Korean SCARED scores did not correlate with CD of the DBD (r = 0.29, p = 0.25), as well as with the ADHD-RS (r = 0.15, p = 0.07) (Table 2).

Internal consistency

As shown in Table 3, internal consistencies of five factors (for details, see 5. Factor structure) ranged from 0.89 to 0.94. Overall internal consistency was good (Cronbach’s α =0.96).

Table 3 Factor loadings and factor internal consistency (N = 147)
Full size table

Factor structure

Factor analysis showed that the Korean version of the SCARED was comprised of five factors, which reflected generalized anxiety (GAD), panic/somatic symptoms (PD), social anxiety (SP), separation anxiety (SAD) and school avoidance (SA) (Table 3). We determined the number of the factors using Cattell’s scree test, which directs the dropping of components after showing a gradient decline in the scree plot. Our scree test suggested retention of five or six factors; thus, analyses were carried out to assess the interpretability and factor structure of both five- and six-factor structures. The six-factor solution resulted in a factor which contained only two variables, which did not satisfy the general principle that a factor is more stable when it contains at least 3 items or more [39]. In addition, the factor did not yield any significant independent factor based on K-SADS-PL nor DSM-V [40]. Therefore, a five-factor structure was chosen for better interpretation [39]. Every item with the exception of item 4, which had a factor loading of 0.23, exceeded the factor loading of 0.30, the minimum required loading of an item [41]. Two items, items 10 and 15, showed cross loading, which means that two or more items had factor loading of more than 0.32 [41], for the GAD factor (0.34 and 0.33, respectively) and the PD factor (0.66 and 0.42, respectively). The explained variance of the factor structure was 58.9%.

The GAD factor consisted of 12 items, and of these items, ‘I worry about people liking me’ had the highest factor loading (1.01). Factor loadings for all items ranged from 0.37 to 1.01. The PD factor consisted of 11 items, and the item ‘When I get frightened, I feel like I am choking’ scored the highest factor loading (0.99). Factor loadings for PD ranged from 0.42 to 0.99. The SP factor was composed of 8 items, and the factor loadings ranged from 0.23 to 0.93. The item ‘I feel shy with people I don’t know well’ showed the highest factor loading. SAD included 6 items and their factor loadings ranged from 0.53 to 0.79. ‘I am afraid to be alone in the house’ showed the greatest factor loading. The SA factor was composed of 4 items with factor loadings of these items ranging from 0.36 to 0.90. (Table 3).

Comparison of SCARED scores between anxiety group and non-anxiety groups

The comparison of the SCARED scores based on our five-factor structures among the A + D, D only and control groups is presented in Table 4. There were significant group differences in the Korean SCARED scores for generalized anxiety, social anxiety, separation anxiety and school avoidance. The scores of these factors were in the following order: A + D, D only, and control groups. However, A + D and D only group did not show any differences in scores of panic symptoms.

Table 4 Comparison of SCARED among Anxiety + Depression(A + D), Depression only(D only), and Control groups
Full size table

Sensitivity analysis

The absolute fit of the five-factor SCARED we elicited was tested on the independent clinical sample. The model yielded χ2/df value of 2.63, (χ2 = 2021.13, df = 769, p-value < 0.001) which is acceptable [42]. Root Mean Square Error of Approximation (RMSEA) was 0.063 and Standardized Root Mean Square Residual (SRMR) was 0.078, which showed adequate fit to the data [42]. However, relative fit indices showed a moderate fit. The comparative fit index (CFI) was 0.86 and the Tucker-Lewis index (TLI) showed 0.85, which did not reach the optimal cutoff of 0.95 [42, 43]. The standardized factor loadings of the Korean SCARED for the second sample are presented in Table 5. Factor loadings were all higher than 0.36 (Table 5).

Table 5 Standardized factor loadings and factor internal consistency on independent dataset (N = 431)
Full size table

Discussion

As expected, our results showed that the Korean SCARED showed high internal consistency with each subscale demonstrating high internal consistency. This finding is consistent with other validation studies of the English SCARED done in clinical samples, in which Cronbach’s α of subscales ranged from 0.79 to 0.89 [6].

The Korean SCARED also demonstrated good criterion validity. The Korean SCARED total scores had a high correlation with K-SADS-PL anxiety subscales, and a moderate correlation with the CBCL anxious/depressed subscale and the CBCL internalizing scale. These findings may imply the discrepancies between the reports of the participants and their parents because the CBCL was completed by parents. Parents tend to under-report their children’s internalizing symptoms such as depression and anxiety compared to externalizing symptoms because the latter are more evident to parents [44]. In addition, the CBCL anxious/depressed subscale not only measures anxiety, but also depressive symptoms, which may have contributed to the weakened correlation between the SCARED and the CBCL anxious/depressed subscale. Moreover, the Korean SCARED was not associated with the CBCL externalizing scale, CD of the DBD or ADHD-RS, which supports high discriminant validity of the Korean SCARED. Taken together, the Korean SCARED would be a reliable and valid screening tool for anxiety symptoms in youth.

In our sample, exploratory factor analysis produced five factors: GAD, PD, SP, SAD, and SA. This factor structure was comparable to the factor structures produced in other cultures, which generally showed four (GAD, PD, SP, and SAD) to five (GAD, PD, SP, SAD, and SA) factors [5, 6, 18, 45,46,47]. The explained variance in our factor structure (58.9%) was higher than the explained variances from other five-factor solution studies, which ranged between 36.3 and 39.5% [18]. The result might reflect that the factor structure of the Korean SCARED explains anxiety disorders in Korea youth well. However, the prominent difference in the explained variance value can be due to our sample characteristics, which was a clinical sample with a high proportion of the youth having mood problems, whereas the majority of previous SCARED factor analyses were conducted with a community sample. There were differences in some items that comprise the factors compared to Birmaher’s factor structure [5]. Item 4, ‘I get scared when I sleep away from home’, belonged to social anxiety rather than separation anxiety as identified in Birmaher’s study [5]. Item 9, ‘People tell me I look nervous’, and 19, ‘I get shaky’ were included in the generalized anxiety factor, not panic disorders as in Birmaher’s analysis. Finally, item 20, ‘I have nightmares about something bad happening to me’ belonged to generalized anxiety, not separation anxiety as in the original study.

As for item 4, the difference in factor structure may be due to the different age range of participants. In contrast to Birmaher’s study which included children from the age of 9 to 18 years old, our participants were all adolescents, with the age range between 12 to 17 years [5]. Rates of separation anxiety are highest in younger children [48]. However, the SCARED factor structures found in the research of different countries with similar age ranges as our study, resemble the original study by Birmaher. In those studies, item 4 was included in SAD [45, 49]. Another reason for the different results may be related to the cultural differences between South Korea and the United States. For example, in South Korea, sleeping away from home could be because of school retreats (Suhak Yeohaeng in Korean), an educational activity that students are required to attend once or twice a year. This event is conceptually different from the western sports camps in that it requires obligatory participation. At the school retreat, Korean children are often required to collaborate with unfamiliar classmates. In this context, it is possible that a Korean child may interpret item 4 as a situation in which unwanted social interactions are required. This may cause them to have worries about how other people view them, ‘Nun-chi’ in Korean, and social fear, ‘Taein Kongpo’ in Korean. Consistent with this interpretation, item 4 was included in the social phobia factor, highly correlating with items such as ‘I am shy’, ‘I feel shy with people I don’t know well’ and ‘I feel nervous about going to parties, dances, or any place where there will be people that I don’t know well’. In addition, factor loading was relatively low (0.23) compared to other items, which might partially explain the different result.

Another example showing the cultural difference is that item 9, ‘people tell me I look nervous’, can be thought of as a question of how adolescents perceive others’ view of them. GAD worries tend to strongly focus on interpersonal difficulties [50] and prominent self-consciousness [51]. The fact that item 4 and 9 belonged to a different factor compared to Birmaher’s original study [5] may reflect the Korean cultural tendency to worry about other people’s views and assessments rather than their own sense of the self, panic or somatic symptoms. Therefore, these differences in the items comprising the factors might reflect the cultural differences between South Korea and the U.S.

The social anxiety scores prominently differed between our sample and the US clinical sample. The mean scores of A + D group (10.6) and D only group (7.9) in our sample were higher than those from a study with a corresponding US clinical sample (3.7 in anxiety only group and 2.7 in depression only group) [5]. This indicates that Korean adolescents tend to feel more anxious in interpersonal and social situations. This result is in line with the above-mentioned result that Korean adolescents tend to understand item 4 as a social interaction related anxiety rather than separation-related anxiety.

We further investigated how the Korean SCARED can be used to discriminate the A + D, D only and control groups, according to the elicited factor structures. All of the anxiety subscales, excluding PD, significantly distinguished the three groups: scores were the highest in the A + D group and the lowest in the control group. The PD subscale score also followed the same order, but the difference between the A + D and the D only group was not significant. Although the panic disorder is categorized as an anxiety disorder according to DSM-5 [30], depressive disorder is also highly comorbid with panic symptoms [52]. In this sense, the Korean SCARED could not clearly distinguish the A + D comorbid group from the D only group in terms of PD. Nevertheless, the PD subscale distinguished the A + D and the D only groups from the control group. In this respect, the Korean SCARED might be useful as an anxiety assessing tool that can fairly discriminate between the subcategories of anxiety disorders.

Sensitivity analyses demonstrated that our factor structure had a good fit measured by absolute fit indices, SRMR and RMSEA, but a moderate fit by relative fit indices, CFI and TLI. Several factors may have influenced the inadequacy of relative fit indices. First, limitations of our factor structure may have influenced the results, because there were items with cross-loadings (e.g. item 10 and 15) and low factor loading (e.g. item 4). Second, sample size of our primary sample may have affected the results, which met the minimal sample size needed for the factor analysis, but not the optimal size [38]. In addition, composition difference between our primary sample and the independent clinical sample may have affected the results. Our sample was composed of youths with mood disorders and healthy controls, whereas all but one of the independent clinical sample had psychiatric disorders. Our results of low CFI/TLI values and adequate SRMR/RMSEA of our factor structure may be due to the fact that the CFI/TLI are relative fit indices, while the SRMR/RMSEA are absolute indices. Relative fit indices compare the model with null hypothesis, which assumes that all variables are not correlated [53]. Lower than optimal value of relative fit indices may reflect the moderate correlations between inter-factor items, although intra-factor items were highly correlated [54]. However, absolute fit indices are determined by how far the model is from the perfect fit, which is presumed to have a fit of zero [42, 53, 55]. The adequate SRMR suggested that our factor structure captures the data well, and the good RMSEA index indicated that our model fits well relative to degree of freedom [54], which indicates that our factor structure is adaptable to clinical samples. Different modeling formulas seem to have caused the difference in the results, lowering the relative fit indices.

There are several limitations to this study. The sample of the study was not randomly selected from the general population, and depressed patients were recruited from an outpatient clinic. This may obscure the generalizability of the results to the general population. However, we included a control group that can mitigate selection bias. Additionally, participants’ ages were between 12 to 17 years, which can limit the generalizability to younger children. However, sensitivity analysis suggests that the factor structure can be applied to a wider age range of children and adolescents. Another limitation is that parents completed all the questionnaires with the exception of the Korean SCARED, and their reports may significantly differ from the participants’ report regarding the internalizing symptoms such as anxiety and depression [44]. Nevertheless, there are some studies about child and parent agreement that revealed concordance between child and parent reports to be moderate to high [56, 57]. This study was also limited in that the anxiety only group was not included and only the anxious/depressed comorbid group was included in the analysis. Despite this limitation, it is important to note that anxiety disorders are highly comorbid with other psychiatric disorders in adolescents, and thus discriminating anxiety only subjects may be a challenging task. Lastly, the small sample size was another limitation of our study. However, our sample size met the minimum sample size for factor analysis as suggested by Mundfrom [38] and other studies, which state that sample size should be at least 3 times the number of variables or a minimum size of 100 [58, 59].

Despite the above-noted limitations, our study showed that the Korean SCARED is a reliable and valid screening tool for assessing adolescent anxiety with high criterion and discriminant validity. Taking into account the high prevalence and the negative influence on the daily function of adolescents’ anxiety disorders, the Korean SCARED can serve as a utilitarian method to screen anxiety disorders and provide a diagnostic impression about the types of anxiety disorders. Furthermore, investigation of the factor structure suggested [5] a cultural difference of anxiety symptoms between Korean and Western adolescents. Future studies that utilize the SCARED to explore sub-anxiety differences among countries are needed, which might reveal additional cultural differences.

Conclusion

Our study suggests that the Korean SCARED is a promising screening tool for assessing adolescent anxiety to be used practically in community settings as well as clinical environments including primary care. The fact that different items comprised the factors may reflect cultural differences in experiencing anxiety between youth in the United States and Korea; Korean youth report higher social fears and worry about how other people view them.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

A + D (Anxiety + Depression):

Participants with co-morbid anxiety disorders and MDD

ADHD-RS:

ADHD Rating Scale

CBCL:

Child Behavior Checklist

CDRS-R:

Children’s Depression Rating Scale-Revised

CFI:

Comparative fit index

D only:

Participants with MDD only

DBD:

Disruptive Behavioral Disorder Scale

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders-5th Edition

GAD:

Generalized anxiety

IQ:

Intelligence quotient

K-SADS-PL:

Kiddie-Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version

MDD:

Major depressive disorder

PD:

Panic/somatic symptoms

RCMAS:

Revised Children’s Manifest Anxiety Scale (RCMAS)

RMSEA:

Root Mean Square Error of Approximation

SA:

School avoidance

SAD:

Separation anxiety

SCARED:

Screen for Child Anxiety Related Emotional Disorders

SP:

Social anxiety

SRMR:

Standardized Root Mean Square Residual

STAIC:

State-Trait Anxiety Inventory

TLI:

Tucker-Lewis index

References

  1. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of dsm-iv disorders in the national comorbidity survey replication adolescent supplement. Arch Gen Psychiatry. 2012;69(4):372–80.

    Article  PubMed  Google Scholar 

  2. Park S, Kim B-N, Cho S-C, Kim J-W, Shin M-S, Yoo H-J. Prevalence, correlates, and comorbidities of DSM-IV psychiatric disorders in children in Seoul, Korea. Asia Pac J Public Health. 2015;27(2):NP1942–NP51.

    Article  PubMed  Google Scholar 

  3. Kim B-N, Park E-J, Choi T-Y, Kwak Y-S. Prevalence and risk factors of psychiatric disorders in child and adolescent population-shool based research. Ministry of Health and Welfare, Korean mental health technology R&D project; 2018.

  4. Wren FJ, Berg EA, Heiden LA, Kinnamon CJ, Ohlson LA, Bridge JA, et al. Childhood anxiety in a diverse primary care population: parent-child reports, ethnicity and SCARED factor structure. J Am Acad Child Adolesc Psychiatry. 2007;46(3):332–40.

    Article  PubMed  Google Scholar 

  5. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, et al. The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997;36(4):545–53.

    Article  CAS  PubMed  Google Scholar 

  6. Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M. Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry. 1999;38(10):1230–6.

    Article  CAS  PubMed  Google Scholar 

  7. Kim KM, Nam S, Choi JW, Jung AH, Hong SB, Kim JW, et al. Psychometric properties and factor structures of the Korean version of Children's depression rating scale-revised. J Child Adolesc Psychopharmacol. 2018;28(4):285–92.

    Article  PubMed  Google Scholar 

  8. Wu Y, Bang MY. Analysis of variables influencing social anxiety of at-risk adolescents. J Emotional Behav Disord. 2012;28(2):235–53.

    Google Scholar 

  9. Kim J-B. “A study of influencing factors to teenagers’ maladjustment at school life”- the main focus on maladjustment teenagers. Korean J Clin Soc Work. 2009;6(2):25–48.

    Google Scholar 

  10. Kim MY, Kim JM. A study on the influencing mental health factors to suicidal ideation in adolescents. Korean J Youth Stud. 2013;20(12):267–93.

    Google Scholar 

  11. Mo SH, Kim HJ, Lee SY. A study on mental health improvement policy for children and adolescents : general report. National Youth Policy Institute; 2013.

  12. Perrin S, Last CG. Do childhood anxiety measures measure anxiety? J Abnorm Child Psychol. 1992;20(6):567–78.

    Article  CAS  PubMed  Google Scholar 

  13. Lim YB, Kim JW, Hong S-B, Kim J-W. Association between BDNF and antidepressant effects of exercise in youth: A preliminary study. J Korean Acad Child Adolesc Psychiatry. 2016;27(1):72–81.

    Article  Google Scholar 

  14. Kim JY, Lee CH, Kim H-M. Behavioral consequences of children with sleep-disordered breathing after adenotonsillectomy. World J Pediatr. 2018;14(1):57–65.

    Article  PubMed  Google Scholar 

  15. Weitkamp K, Romer G, Rosenthal S, Wiegand-Grefe S, Daniels J. German screen for child anxiety related emotional disorders (SCARED): reliability, validity, and cross-informant agreement in a clinical sample. Child Adolesc Psychiatry Ment Health. 2010;4:19.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hale WW, Raaijmakers QAW, García-López LJ, Fernández LE, Muela JA, MdMD C. Psychometric Properties of the Screen for Child Anxiety Related Emotional Disorders for Socially Anxious and Healthy Spanish Adolescents. Span J Psychol. 2013;16:E25.

    Article  PubMed  Google Scholar 

  17. Monga S, Birmaher B, Chiappetta L, Brent D, Kaufman J, Bridge J, et al. Screen for child anxiety-related emotional disorders (SCARED): convergent and divergent validity. Depress Anxiety. 2000;12(2):85–91.

    Article  CAS  PubMed  Google Scholar 

  18. Hale WW, Crocetti E, Raaijmakers QA, Meeus WH. A meta-analysis of the cross-cultural psychometric properties of the screen for child anxiety related emotional disorders (SCARED). J Child Psychol Psychiatry. 2011;52(1):80–90.

    Article  PubMed  Google Scholar 

  19. Hariz N, Bawab S, Atwi M, Tavitian L, Zeinoun P, Khani M, et al. Reliability and validity of the Arabic screen for child anxiety related emotional disorders (SCARED) in a clinical sample. Psychiatry Res. 2013;209(2):222–8.

    Article  PubMed  Google Scholar 

  20. Caporino NE, Sakolsky D, Brodman DM, McGuire JF, Piacentini J, Peris TS, et al. Establishing clinical cutoffs for response and remission on the screen for child anxiety related emotional disorders (SCARED). J Am Acad Child Adolesc Psychiatry. 2017;56(8):696–702.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kim EJ, Cho YR. The relationship of social phobia with the concern for offending others, anger-related variables, and individualism-collectivism. Korean J Clin Psychol. 2008;27(3):613–32.

    Article  Google Scholar 

  22. Song JY, Park KH. The sociocultural variables influencing social anxiety with concern for offending others: focusing on Che-myeon, nun-chi, and self-construal. Korean J Health Psychol. 2009;14(2):329–43.

    Article  Google Scholar 

  23. Oh K-S, Huh M-Y, Lee S-H. Correlations of Social Anxiety and Socio-Cultural Factors. J Korean Neuropsychiatr Assoc. 1999;38(1).

  24. Association AP. Diagnostic and statistical manual of mental disorder. Washington, DC: American Psychiatric Association; 1994.

    Google Scholar 

  25. Cho YR, Kim EJ. Social phobia with concern for offending others: reliability and validity of a Korean version of the TKS. Korean J Clin Psychol. 2005;24(2):397–411.

    Google Scholar 

  26. Lee E. Construction of a structural model about male and female adolescents' alienation, depression, and suicidal thoughts. Taehan Kanho Hakhoe chi. 2007;37(4):576–85.

    PubMed  Google Scholar 

  27. Ivarsson T, Skarphedinsson G, Andersson M, Jarbin H. The validity of the screen for child anxiety related emotional disorders revised (SCARED-R) scale and sub-scales in Swedish youth. Child Psychiatry Hum Dev. 2018;49(2):234–43.

    Article  PubMed  Google Scholar 

  28. Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36(7):980–8.

    Article  CAS  PubMed  Google Scholar 

  29. Kaufman JB, B.; Brent, D.; Rao, U.M.A.; Flynn, C., Moreci, P. Schedule for affective disorders and schizophrenia forSchool aged children: present and lifetime version for DSM-5(K-SADS-PL DSM-5): Western psychiatric institute and Yale University; 2016.

  30. Association AP. Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Publishing; 2013.

  31. Poznanski EO, Mokros HB. Children's depression rating scale-revised (CDRS-R) manual. Los Angeles: Western Psychological Services; 1996.

    Google Scholar 

  32. Guy W ECDEU assessment manual for psychopharmacology. Rockville, Md.: U.S. Dept. of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration, National Institute of Mental Health, Psychopharmacology Research Branch, Division of Extramural Research Programs; 1976.

  33. Kim M-J. A validation study of the SCARED: for the elementary school upper grades and middle school students. Seoul: Sookmyung Women's University; 2010.

    Google Scholar 

  34. Nakamura BJ, Ebesutani C, Bernstein A, Chorpita BF. A psychometric analysis of the child behavior checklist DSM-oriented scales. J Psychopathol Behav Assess. 2009;31(3):178–89.

    Article  Google Scholar 

  35. Kent KM, Pelham WE Jr, Molina BS, Sibley MH, Waschbusch DA, Yu J, et al. The academic experience of male high school students with ADHD. J Abnorm Child Psychol. 2011;39(3):451–62.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Silva RR, Alpert M, Pouget E, Silva V, Trosper S, Reyes K, et al. A rating scale for disruptive behavior disorders, based on the DSM-IV item pool. Psychiatry Q. 2005;76(4):327–39.

    Article  Google Scholar 

  37. Pappas D. ADHD rating scale-IV: checklists, norms, and clinical interpretation. J Psychoeduc Assess. 2006;24(2):172–8.

    Article  Google Scholar 

  38. Mundfrom DJ, Shaw DG, Ke TL. Minimum sample size recommendations for conducting factor analyses. Int J Test. 2005;5(2):159–68.

    Article  Google Scholar 

  39. Costello AB, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the Most from your analysis. Pract Assess Res Eval. 2005;10:173–8.

    Google Scholar 

  40. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and Dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess. 2004;26(1):41–54.

    Article  Google Scholar 

  41. Tabachnick BG, Fidell LS. Using multivariate statistics. Boston: Allyn and Bacon; 2001.

    Google Scholar 

  42. Hooper D, Coughlan J, Mullen MR. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6(1):53–60.

    Google Scholar 

  43. Vahedi S, Farrokhi F. A confirmatory factor analysis of the structure of abbreviated math anxiety scale. Iran J Psychiatry. 2011;6(2):47.

    PubMed  PubMed Central  Google Scholar 

  44. Cantwell DP, Lewinsohn PM, Rohde P, Seeley JR. Correspondence between adolescent report and parent report of psychiatric diagnostic data. J Am Acad Child Adolesc Psychiatry. 1997;36(5):610–9.

    Article  CAS  PubMed  Google Scholar 

  45. Crocetti E, Hale WW, Fermani A, Raaijmakers Q, Meeus W. Psychometric properties of the screen for child anxiety related emotional disorders (SCARED) in the general Italian adolescent population: a validation and a comparison between Italy and the Netherlands. J Anxiety Disord. 2009;23(6):824–9.

    Article  PubMed  Google Scholar 

  46. Muris P, Merckelbach H, Ollendick T, King N, Bogie N. Three traditional and three new childhood anxiety questionnaires: their reliability and validity in a normal adolescent sample. Behav Res Ther. 2002;40(7):753–72.

    Article  PubMed  Google Scholar 

  47. Muris P, Merckelbach H, Van Brakel A, Mayer AB. The revised version of the screen for child anxiety related emotional disorders (scared-r): further evidence for its reliability and validity. Anxiety Stress Coping. 1999;12(4):411–25.

    Article  CAS  PubMed  Google Scholar 

  48. Costello EJ, Mustillo S, Erkanli A, Keeler G, Angold A. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003;60(8):837–44.

    Article  PubMed  Google Scholar 

  49. Boyd RC, Ginsburg GS, Lambert SF, Cooley MR, Campbell KD. Screen for child anxiety related emotional disorders (SCARED): psychometric properties in an African-American parochial high school sample. J Am Acad Child Adolesc Psychiatry. 2003;42(10):1188–96.

    Article  PubMed  Google Scholar 

  50. Rapee RM. The development of generalized anxiety. Dev Psychopathol Anxiety. 2001:481–503.

  51. Schoenleber M, Chow PI, Berenbaum H. Self-conscious emotions in worry and generalized anxiety disorder. Br J Clin Psychol. 2014;53(3):299–314.

    Article  PubMed  Google Scholar 

  52. Roy-Byrne PP, Stang P, Wittchen H-U, Ustun B, Walters EE, Kessler RC. Lifetime panic–depression comorbidity in the National Comorbidity Survey: association with symptoms, impairment, course and help-seeking. Br J Psychiatry. 2000;176(3):229–35.

    Article  CAS  PubMed  Google Scholar 

  53. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.

    Article  Google Scholar 

  54. Prudon P. Confirmatory Factor Analysis as a Tool in Research Using Questionnaires: A Critique. Compr Psychol. 2015;4:03.CP.4.10.

    Article  Google Scholar 

  55. Kenny DA. Measuring Model Fit. www.davidakenny.net/cm/fit.htm. Accessed 10 Feburary, 2020.

  56. Wren FJ, Bridge JA, Birmaher B. Screening for childhood anxiety symptoms in primary care: integrating child and parent reports. J Am Acad Child Adolesc Psychiatry. 2004;43(11):1364–71.

    Article  PubMed  Google Scholar 

  57. Rappaport BI, Pagliaccio D, Pine DS, Klein DN, Jarcho JM. Discriminant validity, diagnostic utility, and parent-child agreement on the screen for child anxiety related emotional disorders (SCARED) in treatment-and non-treatment-seeking youth. J Anxiety Disord. 2017;51:22–31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Gorsuch RL. Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc; 1983.

    Google Scholar 

  59. Cattell RB. The scientific use of factor analysis. New York: Plenum; 1978.

    Book  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (NRF-2015R1A2A2A01004501) and was supported by Promising-Pioneering Research Program through Seoul National University (SNU) in 2015. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Division of Child and Adolescent Psychiatry, Department of Psychiatry, Seoul National University College of Medicine, 103 Daehak-Ro, Chongno-Gu, Seoul, 03080, Republic of Korea

    Jiyoon Shin, Kyung Hwa Lee, Soon-Beom Hong, Ji Youn Han, Seong Hae Kim, Da Eun Suh & Jae-Won Kim

  2. Department of Psychiatry, Dankook University College of Medicine, Cheonan, 31116, Republic of Korea

    Kyoung Min Kim

  3. Integrative Care Hub, Seoul National University Children’s Hospital, Seoul, 03080, Republic of Korea

    Jung Lee

  4. Department of Psychiatry, Seoul National University Boramae Medical Center, Seoul, 07061, Republic of Korea

    Chi-Hyun Choi

  5. Department of Psychiatry, Korea Armed Forces Capital Hospital, Bundang, Republic of Korea

    Soo-Churl Cho

Authors
  1. Jiyoon Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kyoung Min Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kyung Hwa Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Soon-Beom Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jung Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chi-Hyun Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ji Youn Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Seong Hae Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Da Eun Suh
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Soo-Churl Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jae-Won Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JS, KK., SC, and JK contributed to conception and design of the study. JL, CC, JH, SK., DS, and JK were involved in data acquisition. JS, KK, KL, SH, and JK participated in data analysis. JS, KK, KL, SH, JL, CC, SC and JK contributed to interpretation of the data. JS, KK, KL, JL, CC, DS and JK drafted the manuscript or substantively revised it. All authors agreed to the manuscript for submission and publication. All authors have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Jae-Won Kim.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Institutional Review Board for Human Subjects of Seoul National University Hospital (IRB No. 1504–113-668). Detailed information about the study was provided to the parents and youth and written informed consent was obtained from all participants before entering the study.

Consent for publication

Not applicable.

Competing interests

No conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shin, J., Kim, K.M., Lee, K.H. et al. Psychometric properties and factor structure of the Korean version of the screen for child anxiety related emotional disorders (SCARED). BMC Psychiatry 20, 89 (2020). https://doi.org/10.1186/s12888-020-02505-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-020-02505-3

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us