Skip to main content

Validation of the Thai Assessment of Criteria for Specific Internet-use Disorders (ACSID-11) among young adults

Abstract

Background

The Assessment of Criteria for Specific Internet-use Disorders (ACSID-11) is a consistent and comprehensive instrument to assess symptoms of specific internet-use disorders including those related to gaming, shopping, pornography use disorder, social networks use and gambling considering criteria in the eleventh revision of the International Classification of Diseases (ICD-11). However, to date, there is little evidence supporting instruments assessing major types of specific internet use disorders in Thailand. The aim of this present study was to assess the psychometric properties of the ACSID-11 among Thai young adults.

Methods

A total of 612 participants were recruited. A confirmatory factor analysis (CFA) examined construct validity of the ACSID-11. Cronbach’s α and McDonald’s ω were used to assess reliability of the ACSID-11. Pearson correlations examined relationships between ACSID-11 domains and Internet Gaming Disorder Scale—Short Form (IGDS9-SF) scores.

Results

The CFA supported validity of the Thai version of the ACSID-11 and a four-factor structure. Specific domains of the Thai ACSID-11, particularly gaming, were positively and significantly correlated with IGDS9-SF scores.

Conclusions

Data indicate that the Thai version of the ACSID-11 is a valid and reliable instrument to assess major types of specific internet use disorders. Additional studies are needed to further examine the validity and reliability of the Thai ACSID-11.

Peer Review reports

Introduction

The internet has become an essential part of people’s everyday life and an important vehicle for work, school, and entertainment [1]. Thailand ranked third in internet use in Southeast Asia in 2019 [1], with Thailand showing high levels of internet usage in 77.8% of its total population [2, 3]. Thai people often engage in multiple internet activities such as social networks (29.5%), online shopping (24.6%), and online gaming (18.6%) [2,3,4]. Additionally, Thailand has ranked 17th globally regarding use of online pornography in 2019 [5]. Thus, internet activities have become important for Thai people for communication, obtaining information, and leisure [2, 3]. To the best of the present authors’ knowledge, few studies have examined these and other online activities (shopping, gambling, pornography use, and social networking use) in Thailand or the extent to which addictive engagement may be involved. A recent Thai study highlighted the need for assessments aimed at understanding specific online activities and disorders [6]. Validating instruments for assessing online activities in Thailand is important for healthcare providers and public health efforts to screen for internet-use disorders.

Over the past several decades, behavioral addictions have been formally recognized [7,8,9,10,11], although multiple proposed conditions (e.g., internet addiction (IA), smartphone addiction, shopping/buying disorder, social networks disorder) are not formally recognized as disorders in main psychiatric nomenclature systems. IA has been proposed as a behavioral addiction with poorly controlled use of the internet leading to adverse consequences being a central feature [12, 13]. Significant concerns regarding IA’s negative consequences and related public health issues have arisen [14, 15]. In 2013, the American Psychiatric Association (APA) has proposed internet gaming disorder (IGD) as a potential disorder in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) [16]. According to the diagnostic criteria outlined in the DSM-5, IGD is characterized by impaired control over gaming of at least 12 months duration that has led to clinically relevant functional impairment [17, 18]. Subsequently, gaming disorder (GD) has also been defined by the World Health Organization (WHO) in the ICD-11 [1, 19]. GD is characterized by persistent gaming behavior and impaired control over gaming, increased priority given to gaming over other activities, and continuation/escalation of gaming despite the occurrence of negative consequences [20]. Additionally, functional impairment (in personal, familial, social or other domains due to gaming) is important [21]. A Delphi study supported the ICD-11 guidelines for GD [22]. The inclusion of GD in the ICD-11 should facilitate prevention, treatment, and public health efforts [23, 24].

Although multiple instruments exist for screening and evaluation of GD, they have limitations related to use of different cut-off scores, assessment of disorders as currently defined by nomenclature systems, and variable testing of psychometric properties [25, 26]. Furthermore, some online activities (i.e., online sexual behaviors, social network use, and shopping) may be considered as compulsive, with some not currently defined in nomenclature systems [26, 27], although there may exist ways for diagnosing such concerns [28]. Such problematic online behaviors might be associated with GD or each other [29,30,31]. Given such convergences and the public health implications [32,33,34], a valid psychometric instrument for assessing a range of problematic online activities is important.

It has been proposed that IA should be assessed using two conceptual structures relating to generalized and specific forms [35]. Generalized IA relates to excessive internet use overall while specific IA refers to specified online activities (e.g., involving social networks, gambling, gaming, pornography, or shopping) [36,37,38]. Griffiths [39] suggested that the internet might act as mediator dependent on context, and both generalized and specific forms of IA warrant assessment.

Müller et al. developed the Assessment of Criteria for Specific Internet-use Disorders (ACSID-11), considering specific internet-based activities related to gaming, gambling, pornography, social networks and shopping [30]. The ACSID-11 showed good validity and high reliability for assessing main types of specific internet-use disorders which are based on ICD-11 diagnostic guidelines for GD, although additional research was recommended [30]. To date, while there exist some Thai instruments assessing online activities like social media use (e.g., the Thai Bergen Facebook Addiction Scale (Thai-BFAS) and Thai-Social Media Engagement Scale (T-SMES) [40, 41]), validating Thai instruments for additional types of potential internet-use disorders is relevant and important for healthcare providers, especially as healthcare systems adopt the ICD-11.

Regarding potential cultural influences, Thai sports (e.g., Muay Thai or a traditional material art, football) are important [42]. Electronic sports (eSports or competitive video gaming) is a new activity supported by the Thai government. Accordingly, most Thai people are inclined to watch sports online (i.e., Live scores), and this may link to online gambling [6, 42,43,44]. Moreover, a prior review indicates the cultural differences in porn use between Asian people (including Thai people) and other ethnicity populations [45]. Therefore, the ACSID-11 may help assess addictive behaviors involving gaming and gambling in Thai cultures.

Additionally, to date, there are various self-report psychometric instruments assessing IGD, based on the nine IGD DSM-5 criteria (e.g., Internet Gaming Disorder Scale-Short Form or IGDS9-SF) [46]. Some assess GD based on ICD-11 criteria (e.g., Gaming Disorder Test and Gaming Disorder Scale for Young Adults) [47,48,49]. Because these instruments solely focus on internet gaming or gaming, they can only screen general and overall severity level for IGD or GD symptom experiences [30]. The ACSID-11 is a different psychometric instrument assessing two response types (i.e., frequency and intensity ratings) of GD symptoms [30]. Accordingly, the ACSID-11 may precisely investigate individuals who have risk for developing GD relative to frequency and intensity of gaming [30].

This study aimed to translate the ACSID-11 into Thai and to validate the Thai version of the ACSID-11 via evaluating its psychometric properties, including factor analysis. We hypothesized that the ACSID-11 would show a four-factor structure and be a satisfactory valid and reliable instrument for measuring potential specific internet-use disorders among Thai young adults. Moreover, domains of the ACSID-11 would correlate with other measurements assessing related constructs. Specifically, the ACSID-11 GD domain and IGDS9-SF scores would have significant correlations, while other ACSID-11 domains showing weak or no relationships to IGDS9-SF scores.

Methods

Participants and procedure

A convenience sample of 612 university students, with 444 females, was recruited from various universities located in central, northern, and southern regions of Thailand. Participant recruitment and data collection were completed between September 2022 and January 2023. The eligibility criteria were 1) age ≥ 18 years; 2) could understand and read Thai language; 3) enrolled at a university in Thailand (i.e., undergraduates and postgraduates). Participants were recruited via an online survey link and QR code from SurveyMonkey through Facebook and a university forum by research assistants involved in this study. Because the online survey link was distributed using Facebook, the response rate could not be calculated (i.e., there was no information collected regarding how many participants were invited). However, SurveyMonkey showed that 152 participants disagreed to participate in the study and 142 participants did not complete the entire survey, possibly as there was no incentive for participation. Participants completed online questionnaires that assessed demographics, internet gaming (IGDS9-SF), and internet-use behaviors/disorders (ACSID-11) and took approximately 10 – 15 min. Before participants responded and agreed to participate, they were informed of the study objectives and provided informed consent. The Human Research Ethics of National Cheng Kung University approved the study (NCKU HREC-E-110–486-2).

This study was granted permission from Professor Matthias Brand for translation of the ACSID-11 into Thai. We translated the ACSID-11 using a standard process [50]. First, two independent Thai-English researchers (i.e., in sport sciences and nursing) translated the questionnaire into Thai. Both forward translations were checked, discussed, and consolidated into one forward translation. Second, two independent bilingual linguists fluent in Thai and English made two backward translations from one forward translation into an English version. Then, three experts (i.e., two nurses and one psychologist) convened and evaluated the consistency of conceptual and linguistic elements between the original version and all translations (i.e., three forward and backward translations) to confirm the Thai version of the ACSID-11.

Measures

Demographic information

All participants were asked information regarding their age, gender, self-reported weight and height, any condition or disease during the survey, academic level, and daily hours spent gaming online.

Assessment of Criteria for Specific Internet-use Disorders (ACSID-11)

The ACSID-11 was used to measure specific internet-use disorders, based on ICD-11 criteria for disorders due to addictive behaviors [30]. This questionnaire assesses multiple activities on the internet (i.e., gaming, shopping, pornography use, social networks use, and gambling) during the previous year [30]. The ACSID-11 instrument includes 11 items categorized into three main criteria (i.e., impaired control (IC), increased priority given to the online activity (IP), continuation/escalation (CE)) with three items each and a fourth domain with two additional items (i.e., functional impairment in daily life and marked distress). Participants were first asked about their past-12-month activities on the internet (i.e., gaming, shopping, pornography use, social networks use, and gambling) via ‘yes’ or ‘no’ responses. Then, participants responded to the 11 items for all internet activities that had previously been answered with ‘yes’. An example IC item is, “In the past 12 months, have you had trouble keeping track of when you started the activity, for how long, how intensely, or in what situation you did it, or when you stopped?”. An example IP item is, “In the past 12 months, have you given the activity an increasingly higher priority than other activities?”. An example CE item is, “In the past 12 months, have you continued or increased the activity even though it has threatened or caused you to lose a relationship with someone important to you?”. Functional impairment in daily life was assessed by, “Thinking about all areas of your life, has your life been noticeably affected by the activity in the past 12 months?”. Marked distress was assessed by, “Thinking about all areas of your life, did the activity cause you suffering in the past 12 months?”. Participants indicated two-part responses for frequency (0 = “never”, 1 = “rarely”, 2 = “sometimes”, 3 = “often”) and intensity (0 = “not at all intense”, 1 = “rather not intense”, 2 = “rather intense”, 3 = “intense”) per item for each activity. Final scores were calculated by summing the total relevant items in each domain and overall, with higher scores reflecting greater symptom severity for each activity [30]. The ACSID-11 has demonstrated validity and reliability for measuring possible internet use disorders with good internal consistency for both frequency (α = 0.90 – 0.95) and intensity (α = 0.89 – 0.94) ratings in its German version [30]. The original validation study revealed that all items of the ACSID-11 demonstrated an excellent fit with a four-factor structure which was supported by confirmatory factor analysis (CFA) when compared to a unidimensional structure [30]. All four-factor structures of the ACSID-11 reflect ICD criteria for disorders due to addictive behaviors [30]. The ACSID-11 also demonstrated good reliability in the current sample (α = 0.82 – 0.86 for frequency rating; α = 0.87 – 0.95 for intensity rating).

Internet Gaming Disorder Scale—Short Form (IGDS9-SF)

The IGDS9-SF, based on the nine DSM-5 IGD criteria [48], measured IGD severity. The IGDS9-SF assesses both online and/or offline gaming during the previous year [51]. The 9 items use a five-point Likert type scale (1 = “never”, 2 = “rarely”, 3 = “sometimes”, 4 = “often”, 5 = “very often”). A final score is calculated by summing totals for the nine items, with higher scores reflecting greater IGD severity [52]. An example item is, “Do you feel preoccupied with your gaming behavior?”. The IGDS9-SF has been translated into multiple languages and has demonstrated acceptable validity and reliability in, for example, English (α = 0.94) [51], Turkish (α = 0.89) [53], and Chinese (α = 0.94) versions [54]. The Thai IGDS9-SF used in the present study was translated using standard procedures (i.e., forward translation, back translation, and reconciliation) but had not yet been formally examined for validity in Thailand. Therefore, some initial psychometric properties of the Thai IGDS9-SF using the present sample are briefly reported here: Cronbach’s α = 0.87; unidimensionality is supported by the CFA with fit indices of comparative fit index (CFI) = 0.986, Tucker-Lewis index (TLI) = 0.981, root mean square error of approximation (RMSEA) = 0.033, and standardized root mean square residual (SRMR) = 0.078.

Statistical analysis

All statistical analyses were conducted using Jeffrey's Amazing Statistics Program (JASP) version 0.16.3 [55]. Descriptive analyses were used to examine the characteristics of participants and mean scores of the ACSID-11 and IGDS9-SF. Skewness and kurtosis were examined to determine whether ACSID-11 scores were normally distributed. Most ACSID-11 items (including those assessing gaming, shopping, pornography use, social networks use and online gambling) presented low means and had positive skewness and kurtosis values (Table 2). All ACSID-11 items were examined using factor loadings derived from CFA and the corrected item-total correlation, with a recommended value above 0.4 reflecting acceptability [56, 57]. CFA was used to examine factor structure, using diagonally weighted least square (DWLS) estimation [58, 59]. To examine internal consistency, Cronbach’s α and McDonald’s ω coefficients were used, with the recommended value above 0.7 indicating acceptability [60, 61]. For CFA, we used χ2 statistics, the CFI, TLI, SRMR, and RMSEA to examine goodness of fit indices. Model fit was indicated by non-significant χ2, CFI > 0.9, TLI > 0.9, RMSEA < 0.08, and SRMR < 0.08 [62, 63].

Lastly, convergent validity was determined by using Pearson correlations to examine relationships between ACSID-11 gaming scores, IGDS9-SF scores, and daily hours spent gaming online with the recommended values of |r|= 0.10–0.30 reflecting small effects, |r|= 0.30–0.50 reflecting medium effects, and |r|> 0.50 reflecting large effects [64]. According to previous studies, the IGDS9-SF is a valid instrument for assessing IGD [46, 51]. We therefore investigated convergent validity between gaming concerns assessed using the ACSID-11 and IGDS9-SF. Moreover, because the ACSID-11 assesses other online activities that are different from gaming, these distinct activities would likely not correlate strongly with IGDS9-SF scores. Therefore, we also used the IGDS9-SF to assess divergent validity of the ACSID-11 in non-gaming domains.

Results

According to Table 1, the mean age of participants was 20.57 (SD = 2.29) years with a range between 17 and 33 years. The mean BMI of participants was 21.79 (4.26) kg/m2 with a range between 13.84 and 42.06 kg/m2. Most participants were female (73%), had no condition/diseases (87%), and were undergraduates (96%). The mean reported daily hours spent gaming online was 1.59 (SD = 1.83) hours with a range between 0 and 12 h. Considerable percentages of participants engaged in gaming (57%), online shopping (80%), online pornography use (41%), social networks use (92%) and online gambling (19%). The mean IGDS9-SF score was 13.16 (SD = 4.83) with a range between 9 and 45. Moreover, participants’ information (i.e., age, BMI, daily hours spent gaming, and IGDS9-SF scores) showed positive skewness and kurtosis. The mean ACSID-11 (including frequency and intensity rating) scores is indicated in Table 2.

Table 1 The characteristics of participants (n = 612)
Table 2 Psychometric properties of the ACSID-11 at the item level

CFA supported the four-factor structure of the ACSID-11 (see fit indices in Tables 2 and 3). The ACSID-11 showed good fit of both frequency and intensity ratings with non-significant χ2and values of model fit (i.e., CFI, RMSEA, and SRMR) achieving the suggested cut-offs. Moreover, all types of specific internet use disorders assessed by the ACSID-11 (including frequency and intensity ratings) demonstrated acceptable standardized factor loadings and item-total correlations. Moreover, the internal consistency was acceptable and satisfactory for the four-factor structure including frequency and intensity ratings except for the IC domain of gaming in the frequency rating (both Cronbach’s α and McDonald’s ω = 0.65), the IC domain of online gambling in the frequency rating (Cronbach’s α = 0.54 and McDonald’s ω = 0.55), the IP domain of online gambling in the frequency rating (Cronbach’s α = 0.67) and the FI domain of online gambling in the frequency rating (both Cronbach’s α and McDonald’s ω = 0.68).

Table 3 Index of fit in the confirmatory factor analysis of the ACSID-11

Most of the four ACSID-11 domains (i.e., IC, IP, CE, and FI) were positively correlated with IGDS9-SF scores, showing small to moderate effects (Table 4). For gaming, all four ACSID-11 domains (including frequency and intensity ratings) correlated with IGDS9-SF scores and gaming time, showing moderate effects. For online shopping, only the FI domain of frequency ratings and all domains of intensity ratings correlated with IGDS9-SF scores, showing small effects. For online pornography, most ACSID-11 domains (including frequency and intensity ratings) correlated with IGDS9-SF scores and gaming time, showing small effects. For social networks use, all four ACSID-11 domains (including frequency and intensity ratings) correlated with IGDS9-SF scores, showing small effects, except for the IC domain of frequency ratings; and only the CE domain of intensity ratings of the ACSID-11 for social networks use correlated with gaming time. For online gambling, most ACSID-11 domains (including frequency and intensity ratings) correlated with IGDS9-SF scores and gaming time, showing small effects. All ACSID-11 domains for gaming correlated robustly with other ACSID-11-assessed internet use disorders. Moreover, IGDS9-SF scores correlated with gaming time. showing a moderate effect.

Table 4 Correlation among ACSID-11 scores, IGDS9-SF scores, and gaming time

Discussion

The present study examined the psychometric properties of the Thai ACSID-11 among Thai young adults. The ACSID-11 appears suitable for assessing multiple types of specific internet-use disorders related to gaming, shopping, pornography use, social networks use and gambling among Thai young adults. Findings supported our hypotheses. Specifically, the ACSID-11, regardless of online activity, had four-factor structures with adequate CFA fit indices. Additionally, standardized factor loadings and item-total correlations were acceptable for both frequency and intensity ratings of the Thai ACSID-11, consistent with the original version of ACSID-11 [30].

Regarding reliability, the Thai ACSID-11 demonstrated acceptable internal consistency including frequency and intensity ratings comparable to the original version [30]. However, the results of the IC domain of gaming (frequency rating) and IC, IP and FI and domains of online gambling (frequency ratings) demonstrated slightly lower internal consistency (Cronbach’s α = 0.54 – 0.68 and McDonald’s ω = 0.55—0.68). We suspect that this might reflect the relatively small number of participants reporting online gaming (n = 352) and online gambling (n = 113). In this regard, we suggest that future studies should consider a larger sample of people who engage in online gaming and gambling to further validate these specific internet activities assessed with the ACSID-11.

All four gaming domains of the ACSID-11 demonstrated significant correlations with IGDS9-SF scores and time spent gaming. The original ACSID-11 validation study assessed correlations between ACSID-11 and IGDT-10 (Ten-Item Internet Gaming Disorder Test) scores [30], with ACSID-11 and IGDT-10 scores showing positive correlations [30]. Despite using the IGDS9-SF in place of the IGDT-10, results were comparable given that the IGDS9-SF and IGDT-10 assess similar concepts, the IGDS9-SF is a standardized instrument based on DSM-5 criteria for IGD [51], and scores on the IGDT-10 and IGDS9-SF correlate [65]. Importantly, our findings revealed that the gaming domain of the ACSID-11 was moderately correlated with IGDS9-SF scores while other online activities (i.e., shopping, pornography use, social networks use and online gambling) were uncorrelated or modestly correlated with IGDS9-SF scores, at most showing small effects. Taken together, the current findings suggest specificity but also some inter-relationships between IGD and multiple other types of internet-use disorders related to online shopping, online pornography use, social networks use and gambling.

The present results suggest that some domains are not strongly related to IGD. For example, ACSID-11-assessed online shopping (IC, IP, and CE domains) and social networks use (IC domain) in frequency ratings were not correlated with IGDS9-SF scores. These findings suggest distinct relationships and specific entities related to specific types of internet-use disorders. Future studies should focus on factors related to specific types and patterns of internet-use disorders [32].

Study limitations warrant mention. First, participants were Thai university students and were recruited by convenience sampling. Therefore, our sample might not be representative. Second, data collection involved self-reported questionnaires, and are thus susceptible to related biases (e.g., memory, social desirability). Third, the study sample was moderate in size. Larger studies involving different samples (including clinical populations) should be examined to validate further the Thai ACSID-11, especially with respect to gaming and gambling. Fourth, the study was cross-sectional, and future longitudinal studies should assess other features (e.g., test/retest reliability). Finally, the IGDS9-SF was used to measure convergent (for gaming assessed in the ACSID-11) and divergent (for activities other than gaming assessed in the ACSID-11) validity of the ACSID-11. A limitation was that the ACSID-11 was not examined for convergent validity for non-gaming activities. Future research should use other instruments (e.g., Problematic Pornography Consumption Scale [66] or Brief Pornography Screen [67] for ACSID-11 pornography use or the Bergen Social Media Addiction Scale [68] for ACSID-11 social media use) to examine the convergent validity of specific online activities assessed in the ACSID-11.

In conclusion, the present study expands research on validation tools to assess major types of specific internet-use disorders among Thai university students. The Thai ACSID-11 may be used to assess main types of specific internet-use disorders related to gaming, shopping, pornography use, social networks use and gambling. Larger, diverse populations should be considered in future research to examine further the validity and reliability of the Thai ACSID-11.

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

IA:

Internet addiction

GD:

Gaming disorder

ACSID-11:

Assessment of Criteria for Specific Internet-use Disorders

IGDS9-SF:

Internet Gaming Disorder Scale—Short Form

IGDT-10:

Ten-Item Internet Gaming Disorder Test

CFA:

Confirmatory factor analysis

References

  1. Chia DXY, Ng CWL, Kandasami G, et al. Prevalence of Internet Addiction and Gaming Disorders in Southeast Asia: A Meta-Analysis. Int J Environ Res Public Health. 2020;17(7):2582. https://doi.org/10.3390/ijerph17072582.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Electronic Transactions Development Agency (ETDA). Thailand internet user behavior 2022. 2023. https://www.nationthailand.com/in-focus/national/40019312. Accessed 14 April 2023.

  3. Leesa-Nguansuk S. Thailand's digital dependence revealed in new internet study. 2022. https://www.bangkokpost.com/business/2265383/thailands-digital-dependence-revealed-in-new-internet-study%20. Accessed 14 Apr 2023.

  4. Poon WC, Tung SEH. The rise of online food delivery culture during the COVID-19 pandemic: an analysis of intention and its associated risk. Eur J Manag Bus Econ. 2022; ahead-of-print. https://doi.org/10.1108/EJMBE-04-2021-0128.

  5. Satrusayang C. Thailand cracks Pornhub’s top twenty list despite government efforts. 2020. https://www.thaienquirer.com/8587/thailand-cracks-pornhubs-top-twenty-list-despite-government-efforts/. Accessed 14 April 2023.

  6. Assanangkornchai S, McNeil EB, Tantirangsee N, Kittirattanapaiboon P. Thai National Mental Health Survey Team. Gambling disorders, gambling type preferences, and psychiatric comorbidity among the Thai general population: Results of the 2013 National Mental Health Survey. J Behav Addict. 2016;5(3):410–8. https://doi.org/10.1556/2006.5.2016.066.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Grant JE, Potenza MN, Weinstein A, Gorelick DA. Introduction to behavioral addictions. Am J Drug Alcohol Abuse. 2010;36(5):233–41. https://doi.org/10.3109/00952990.2010.491884.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Purwaningsih E, Nurmala I. The Impact of Online Game Addiction on Adolescent Mental Health: A Systematic Review and Meta-analysis. Open Access Maced J Med Sci. 2021;9(F):260–74. https://doi.org/10.3889/oamjms.2021.6234.

    Article  Google Scholar 

  9. Purwaningsih E, Nurmala I, Fatah MZ. Systematic review of health promotion policies or regulations with CCAT theory. J Public Health Res. 2023;12(1):22799036231153480. https://doi.org/10.1177/22799036231153479.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Robbins TW, Clark L. Behavioral addictions. Curr Opin Neurobiol. 2015;30:66–72. https://doi.org/10.1016/j.conb.2014.09.005.

    Article  CAS  PubMed  Google Scholar 

  11. Widyanto L, Griffiths M. ‘Internet Addiction’: A Critical Review. Int J Ment Health Addiction. 2006;4:31–51. https://doi.org/10.1007/s11469-006-9009-9.

    Article  Google Scholar 

  12. Mitchell P. Internet addiction: genuine diagnosis or not? Lancet (London, England). 2000;355(9204):632. https://doi.org/10.1016/S0140-6736(05)72500-9.

    Article  CAS  PubMed  Google Scholar 

  13. Pan YC, Chiu YC, Lin YH. Systematic review and meta-analysis of epidemiology of internet addiction. Neurosci Biobehav Rev. 2020;118:612–22. https://doi.org/10.1016/j.neubiorev.2020.08.013.

    Article  PubMed  Google Scholar 

  14. Błachnio A, Przepiórka A, Gorbaniuk O, et al. Cultural Correlates of Internet Addiction. Cyberpsychol Behav Soc Netw. 2019;22(4):258–63. https://doi.org/10.1089/cyber.2018.0667.

  15. Mo PK, Chan VW, Wang X, Lau JT. Gender difference in the association between internet addiction, self-esteem and academic aspirations among adolescents: A structural equation modelling. Comput Educ. 2020;155: 103921. https://doi.org/10.1016/j.compedu.2020.103921.

    Article  Google Scholar 

  16. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington, VA: American Psychiatric Publishing; 2013.

    Book  Google Scholar 

  17. Liao Z, Chen X, Huang Q, Shen H. Prevalence of gaming disorder in East Asia: A comprehensive meta-analysis. J Behav Addict. 2022;11(3):727–38. https://doi.org/10.1556/2006.2022.00050.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Yen JY, Lin HC, Chou WP, Liu TL, Ko CH. Associations Among Resilience, Stress, Depression, and Internet Gaming Disorder in Young Adults. Int J Environ Res Public Health. 2019;16(17):3181. https://doi.org/10.3390/ijerph16173181.

    Article  PubMed  PubMed Central  Google Scholar 

  19. World health organization. Gaming disorder. 2023. https://www.who.int/standards/classifications/frequently-asked-questions/gaming-disorder. Accessed 20 Apr 2023.

  20. Borges G, Orozco R, Benjet C, et al. (Internet) Gaming Disorder in DSM-5 and ICD-11: A Case of the Glass Half Empty or Half Full: (Internet) Le trouble du jeu dans le DSM-5 et la CIM-11: Un cas de verre à moitié vide et à moitié plein. Can J Psychiatry. 2021;66(5):477–84. https://doi.org/10.1177/0706743720948431.

    Article  PubMed  Google Scholar 

  21. Billieux J, Stein DJ, Castro-Calvo J, Higushi S, King DL. Rationale for and usefulness of the inclusion of gaming disorder in the ICD-11. World Psychiatry. 2021;20(2):198–9. https://doi.org/10.1002/wps.20848.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Castro-Calvo J, King DL, Stein DJ, et al. Expert appraisal of criteria for assessing gaming disorder: an international Delphi study. Addiction. 2021;116(9):2463–75. https://doi.org/10.1111/add.15411.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Rumpf HJ, Achab S, Billieux J, et al. Including gaming disorder in the ICD-11: The need to do so from a clinical and public health perspective. J Behav Addict. 2018;7(3):556–61. https://doi.org/10.1556/2006.7.2018.59.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Stevens MW, Dorstyn D, Delfabbro PH, King DL. Global prevalence of gaming disorder: A systematic review and meta-analysis. Aust N Z J Psychiatry. 2021;55(6):553–68. https://doi.org/10.1177/0004867420962851.

    Article  PubMed  Google Scholar 

  25. King DL, Chamberlain SR, Carragher N, et al. Screening and assessment tools for gaming disorder: A comprehensive systematic review. Clin Psychol Rev. 2020;77: 101831. https://doi.org/10.1016/j.cpr.2020.101831.

    Article  PubMed  Google Scholar 

  26. Burleigh TL, Griffiths MD, Sumich A, Stavropoulos V, Kuss DJ. A systematic review of the co-occurrence of Gaming Disorder and other potentially addictive behaviors. Curr Addict Rep. 2019;6:383–401. https://doi.org/10.1007/s40429-019-00279-7.

    Article  Google Scholar 

  27. Asrese K, Muche H. Online activities as risk factors for Problematic internet use among students in Bahir Dar University, North West Ethiopia: A hierarchical regression model. PLoS ONE. 2020;15(9):e0238804. https://doi.org/10.1371/journal.pone.0238804.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Brand M, Rumpf HJ, Demetrovics Z, et al. Which conditions should be considered as disorders in the International Classification of Diseases (ICD-11) designation of “other specified disorders due to addictive behaviors”? J Behav Addict. 2020;11(2):150–9. https://doi.org/10.1556/2006.2020.00035.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Castro-Calvo J, Ballester-Arnal R, Potenza MN, King DL, Billieux J. Does, “forced abstinence” from gaming lead to pornography use? Insight from the April 2018 crash of Fortnite’s servers. J Behav Addict. 2018;7(3):501–2. https://doi.org/10.1556/2006.7.2018.78.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Müller SM, Wegmann E, Oelker A, et al. Assessment of Criteria for Specific Internet-use Disorders (ACSID-11): Introduction of a new screening instrument capturing ICD-11 criteria for gaming disorder and other potential Internet-use disorders. J Behav Addict. 2022;11:427–50. https://doi.org/10.1556/2006.2022.00013.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Shi J, Colder Carras M, Potenza MN, Turner NE. A Perspective on Age Restrictions and Other Harm Reduction Approaches Targeting Youth Online Gambling, Considering Convergences of Gambling and Videogaming. Front Psychiatry. 2021;11(2):601712. https://doi.org/10.3389/fpsyt.2020.601712.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Brand M, Young KS, Laier C, Wölfling K, Potenza MN. Integrating psychological and neurobiological considerations regarding the development and maintenance of specific Internet-use disorders: An Interaction of Person-Affect-Cognition-Execution (I-PACE) model. Neurosci Biobehav Rev. 2016;71:252–66. https://doi.org/10.1016/j.neubiorev.2016.08.033.

    Article  PubMed  Google Scholar 

  33. Griffiths MD. Internet sex addiction: A review of empirical research. Addict Res Theory. 2012;20(2):111–24. https://doi.org/10.3109/16066359.2011.588351.

    Article  Google Scholar 

  34. Kuss DJ, Griffiths MD. Online social networking and addiction–a review of the psychological literature. Int J Environ Res Public Health. 2011;8(9):3528–52. https://doi.org/10.3390/ijerph8093528.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Pontes HM, Griffiths MD. Internet addiction disorder and internet gaming disorder are not the same. J Addict Res Ther. 2014;5(4):e124. https://doi.org/10.4172/2155-6105.1000e124.

    Article  Google Scholar 

  36. Chen IH, Pakpour AH, Leung H, et al. Comparing generalized and specific problematic smartphone/internet use: Longitudinal relationships between smartphone application-based addiction and social media addiction and psychological distress. J Behav Addict. 2020;9(2):410–9. https://doi.org/10.1556/2006.2020.00023.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Montag C, Bey K, Sha P, et al. Is it meaningful to distinguish between generalized and specific Internet addiction? Evidence from a cross-cultural study from Germany, Sweden Taiwan and China. Asia Pac Psychiatry. 2015;7(1):20–6. https://doi.org/10.1111/appy.12122.

    Article  PubMed  Google Scholar 

  38. Poon WC, Tung SEH. Consumer risk perception of online food delivery during the COVID-19 Movement Control Order (MCO) in Malaysia. J Foodserv Bus Res. 2023;26(2):381–401. https://doi.org/10.1080/15378020.2022.2054657.

    Article  Google Scholar 

  39. Griffiths MD. Internet addiction-time to be taken seriously? Addict Res. 2000;8(5):413–8. https://doi.org/10.3109/16066350009005587.

    Article  Google Scholar 

  40. Phanasathit M, Manwong M, Hanprathet N, Khumsri J, Yingyeun R. Validation of the Thai version of Bergen Facebook addiction scale (Thai-BFAS). J Med Assoc. 2015;98(Suppl 2):S108–17.

    Google Scholar 

  41. Wisessathorn M, Pramepluem N, Kaewwongsa S. Factor structure and interpretation on the Thai-Social Media Engagement Scale (T-SMES). Heliyon. 2022;8(7):e09985. https://doi.org/10.1016/j.heliyon.2022.e09985.

    Article  PubMed  PubMed Central  Google Scholar 

  42. BeSoccer. Sports in Thailand: Exploring the Most Popular Activities and Interesting Facts. 2023. https://www.besoccer.com/new/sports-in-thailand-exploring-the-most-popular-activities-and-interesting-facts-1244515. Accessed 28 August 2023.

  43. Millington, S. The growth of sport and esport in Thailand. 2021. https://www.nielsen.com/news-center/2021/the-growth-of-sport-and-esport-in-thailand/. Accessed 28 August 2023.

  44. Wattanapisit A, Wattanapisit S, Wongsiri S. Public Health Perspectives on eSports. Public Health Rep. 2020;135(3):295–8. https://doi.org/10.1177/0033354920912718.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Ahorsu DK, Adjorlolo S, Nurmala I, et al. Problematic Porn Use and Cross-Cultural Differences: A Brief Review. Curr Addict Rep. 2023. https://doi.org/10.1007/s40429-023-00505-3.

    Article  Google Scholar 

  46. Poon LYJ, Tsang HWH, Chan TYJ, et al. Psychometric Properties of the Internet Gaming Disorder Scale-Short-Form (IGDS9-SF): Systematic Review. J Med Internet Res. 2021;23(10):e26821. https://doi.org/10.2196/26821.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Ghazi FR, Gan WY, Tung SEH, et al. Problematic Gaming in Malaysian University Students: Translation and Psychometric Evaluation of the Malay Language Versions of Gaming Disorder Test and Gaming Disorder Scale for Young Adults. Eval Health Prof. 2023;1632787231185845. https://doi.org/10.1177/01632787231185845.

  48. Chen IH, Chang YL, Yang YN, et al. Psychometric properties and development of the Chinese versions of Gaming Disorder Test (GDT) and Gaming Disorder Scale for Adolescents (GADIS-A). Asian J Psychiatr. 2023;86:103638. https://doi.org/10.1016/j.ajp.2023.103638.

    Article  PubMed  Google Scholar 

  49. Wu TY, Huang SW, Chen JS, et al. Translation and Validation of the Gaming Disorder Test and Gaming Disorder Scale for Adolescents into Chinese for Taiwanese Young Adults. Compr Psychiatry. 2023;124:152396. https://doi.org/10.1016/j.comppsych.2023.152396.

    Article  PubMed  Google Scholar 

  50. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91. https://doi.org/10.1097/00007632-200012150-00014.

    Article  CAS  PubMed  Google Scholar 

  51. Pontes HM, Griffiths MD. Measuring DSM-5 internet gaming disorder: Development and validation of a short psychometric scale. Comput Hum Behav. 2015;45:137–43. https://doi.org/10.1016/j.chb.2014.12.006.

    Article  Google Scholar 

  52. Tung SEH, Gan WY, Chen JS, et al. Internet-Related Instruments (Bergen Social Media Addiction Scale, Smartphone Application-Based Addiction Scale, Internet Gaming Disorder Scale-Short Form, and Nomophobia Questionnaire) and Their Associations with Distress among Malaysian University Students. Healthcare (Basel). 2022;10(8):1448. https://doi.org/10.3390/healthcare10081448.

    Article  PubMed  Google Scholar 

  53. Evren C, Dalbudak E, Topcu M, Kutlu N, Evren B, Pontes HM. Psychometric validation of the Turkish nine-item Internet Gaming Disorder Scale-Short Form (IGDS9-SF). Psychiatry Res. 2018;265:349–54. https://doi.org/10.1016/j.psychres.2018.05.002.

    Article  PubMed  Google Scholar 

  54. Leung H, Pakpour AH, Strong C, et al. Measurement invariance across young adults from Hong Kong and Taiwan among three internet-related addiction scales: Bergen Social Media Addiction Scale (BSMAS), Smartphone Application-Based Addiction Scale (SABAS), and Internet Gaming Disorder Scale-Short Form (IGDS-SF9) (Study Part A). Addict Behav. 2020;101:105969. https://doi.org/10.1016/j.addbeh.2019.04.027.

    Article  PubMed  Google Scholar 

  55. JASP Team. JASP Version 0.16.3. JASP Team: Amsterdam, The Netherlands; 2022.

  56. Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis. 8th ed. India: Cengage Noida; 2018.

    Google Scholar 

  57. Wang Y-S, Wang H-Y, Shee DY. Measuring e-learning systems success in an organizational context: Scale development and validation. Comput Hum Behav. 2007;23(4):1792–808. https://doi.org/10.1016/j.chb.2005.10.006.

    Article  Google Scholar 

  58. Nestler S. A Monte Carlo study comparing PIV, ULS and DWLS in the estimation of dichotomous confirmatory factor analysis. Br J Math Stat Psychol. 2013;66(1):127–43. https://doi.org/10.1111/j.2044-8317.2012.02044.x.

    Article  PubMed  Google Scholar 

  59. Wu TH, Chang CC, Chen CY, Wang JD, Lin CY. Further psychometric evaluation of the self-stigma scale-short: measurement invariance across mental illness and gender. PLoS ONE. 2015;10(2):e0117592. https://doi.org/10.1371/journal.pone.0117592.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  60. Kalkbrenner MT. Alpha, Omega, and H Internal consistency reliability estimates: Reviewing these options and when to use them. Couns Outcome Res Eval. 2023;14(1):77–88. https://doi.org/10.1080/21501378.2021.1940118.

    Article  Google Scholar 

  61. Nunnally JC. Psychometric theory. 2nd ed. New York: McGraw-Hill; 1978.

    Google Scholar 

  62. Lin CY, Griffiths MD, Pakpour AH. Psychometric evaluation of Persian Nomophobia Questionnaire: Differential item functioning and measurement invariance across gender. J Behav Addict. 2018;7(1):100–8. https://doi.org/10.1556/2006.7.2018.11”.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Cheng CP, Luh WM, Yang AL, Su CT, Lin CY. Agreement of children and parents scores on Chinese version of Pediatric Quality of Life Inventory Version 4.0: Further psychometric development. Appl Res Qual Life. 2016;11(3):891–906. https://doi.org/10.1007/s11482-015-9405-z.

    Article  CAS  Google Scholar 

  64. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Erlbaum; 1988.

    Google Scholar 

  65. Evren C, Evren B, Dalbudak E, Topcu M, Kutlu N. Psychometric validation of the Turkish ten-item internet gaming disorder test (IGDT-10). Dusunen Adam. 2020;33:19–28.

    Google Scholar 

  66. Bőthe B, Tóth-Király I, Zsila Á, Griffiths MD, Demetrovics Z, Orosz G. The Development of the Problematic Pornography Consumption Scale (PPCS). J Sex Res. 2018;55(3):395–406. https://doi.org/10.1080/00224499.2017.1291798.

    Article  PubMed  Google Scholar 

  67. Kraus SW, Gola M, Grubbs JB, et al. Validation of a Brief Pornography Screen across multiple samples. J Behav Addict. 2020;9(2):259–71. https://doi.org/10.1556/2006.2020.00038.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Pramukti I, Nurmala I, Nadhiroh SR, et al. Problematic use of internet in Indonesia university students: Psychometric evaluation of Bergen Social Media Addiction Scale and Internet Gaming Disorder Scale-Short Form. Psychiatry Investig (forthcoming). 2023.

Download references

Acknowledgements

We sincerely thank all the teaching faculty and research assistants who helped in the present study. We also thank all the participants for their involvement in the present study.

Funding

This research was supported in part by (received funding from) the Ministry of Science and Technology, Taiwan (MOST 110–2410-H-006–115; MOST 111–2410-H-006–100), the National Science and Technology Council, Taiwan (NSTC 112-2410-H-006-089-SS2), the internal fund of E-Da Hospital (EDAHP108049), the Higher Education Sprout Project, the Ministry of Education at the Headquarters of University Advancement at the National Cheng Kung University (NCKU), and the 2022 Southeast and South Asia and Taiwan Universities Joint Research Scheme (NCKU 35). Dr. Potenza was supported by the Connecticut Council on Problem Gambling and the NIH grant D43 TW012262. This project was supported by the International Research Collaboration Fund granted by the Department of Social Work, The Chinese University of Hong Kong (Grant number: 19231106).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization, Y.-N.Y, J.-A.S., P.A., J.-S.C., M.N.P., A.H.P., R.K., and C.-Y.L.; Investigation, R.K., P.A..; Methodology, Y.-N.Y., J.-A.S., P.A., J.S.C., M.N.P., A.H.P., J.-K.C., E.P., I.N., R.K., and C.-Y.L.; Supervision, Y.-N.Y, J.-A.S., P.A., R.K., and C.-Y.L.; Writing—original draft preparation, R.K. and C.-Y.L.; writing—review and editing, Y.-N.Y, J.-A.S., P.A., J.S.C., M.N.P., A.H.P., J.-K.C., E.P., I.N., R.K., and C.-Y.L; Visualization, Y.N.Y., J.-A.S., P.A., J.S.C., M.N.P., A.H.P., J.-K.C., E.P., I.N., R.K., and C.-Y.L. All authors have read and agreed to the published version of the manuscript.

Corresponding authors

Correspondence to Kamolthip Ruckwongpatr or Chung-Ying Lin.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The present study has been approved by the ethics committee at The Human Research Ethics of National Cheng Kung University approved the study (NCKU HREC-E-110–486-2). All the participants have provided a written informed consent.

Consent for publication

The present study does not report any individual person’s data; therefore, there is no consent for publication.

Competing interests

The authors declare no competing interests with respect to the content of this manuscript. Dr. Potenza has consulted for Opiant Therapeutics, Game Day Data, Baria-Tek, the Addiction Policy Forum, AXA and Idorsia Pharmaceuticals; been involved in a patent application with Yale University and Novartis; received research support from the Mohegan Sun Casino, Children and Screens and the Connecticut Council on Problem Gambling; consulted for legal and gambling entities on issues related to impulse control, internet use and addictions; has edited journals and journal sections; has given academic lectures in grand rounds, CME events and other clinical or scientific venues; and has generated books or book chapters for publishers of mental health texts. The other authors report no disclosures.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, YN., Su, JA., Pimsen, A. et al. Validation of the Thai Assessment of Criteria for Specific Internet-use Disorders (ACSID-11) among young adults. BMC Psychiatry 23, 819 (2023). https://doi.org/10.1186/s12888-023-05210-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-023-05210-z

Keywords