Psychometric analysis of the new ADHD DSM-V derived symptoms
BMC Psychiatry volume 12, Article number: 21 (2012)
Following the agreements on the reformulating and revising of ADHD diagnostic criteria, recently, the proposed revision for ADHD added 4 new symptoms to the hyperactivity and Impulsivity aspect in DSM-V. This satudy investigates the psychometric properties of the proposed ADHD diagnostic criteria.
ADHD diagnosis was made according to DSM-IV. The parents completed the screening test of ADHD checklist of Child Symptom Inventory-4 and the 4 items describing the new proposed symptoms in DSM-V.
The confirmatory factor analysis of the ADHD DSM-V derived items supports the loading of two factors including inattentiveness and hyperactivity/impulsivity. There is a sufficient reliability for the items. However, confirmatory factor analysis showed that the three-factor model is better fitted than the two-factor one. Moreover, the results of the exploratory analysis raised some concerns about the factor loading of the four new items.
The current results support the two-factor model of the DSM-V ADHD diagnostic criteria including inattentiveness and hyperactivity/impulsivity. However, the four new items can be considered as a third factor.
Attention-deficit/hyperactivity disorder (ADHD) is one of the most common behavioral disorders in children and adolescents. Its rate in community samples is variably reported. A study reported the rate of 5.29% . Meanwhile, the rate of its screening symptoms is much higher, reaching up to 10.1% in school age children . This high rate of ADHD prevalence emphasizes the need for accurate identification and diagnosis of ADHD .
There has been a recent significant argument or controversy regarding the necessity of reformulating and revising ADHD criteria [1, 4, 5]. For example, recent criticism of the current ADHD subtypes and the suggestion of including age-specific ADHD criteria in DSM V should be considered . In addition, the current ADHD subtypes are frequently criticized . Some researchers are interested in introducing ADHD-inattentive type as a learning disorder . Furthermore, there is a debate whether oppositional defiant disorder should be considered as a type of ADHD [8, 9]. Girls with ADHD are underdiagnosed in the community . Moreover, the impact of the change in the age of the onset has been investigated .
Given that the proposed DSM-V criteria for ADHD are available and would be implemented in the near future , it is advised that their psychometric properties and modifications be studied before their clinical application. To the best of the author's knowledge, there are no published studies investigating the psychometric properties of the proposed ADHD diagnostic criteria for DSM-V.
DSM-IV defines ADHD as a cluster of symptoms; the patient must have at least six or more out of the 9 symptoms of inattention and/or six or more out of the 9 symptoms of hyperactivity/impulsivity . The proposed revision of ADHD by American Psychiatric Association added 4 new symptoms to the Hyperactivity and Impulsivity aspect in DSM- V. These four symptoms are: "Tends to act without thinking, such as starting tasks without adequate preparation or avoiding reading or listening to instructions, may speak out without considering consequences or make important decisions on the spur of the moment, such as impulsively buying items, suddenly quitting a job, or breaking up with a friend", "Is often impatient, as shown by feeling restless when waiting for others and wanting to move faster than others, wanting people to get to the point, speeding while driving, and cutting into traffic to go faster than others", "Is uncomfortable doing things slowly and systematically and often rushes through activities or tasks", and "Finds it difficult to resist temptations or opportunities, even if it means taking risks (A child may grab toys off a store shelf or play with dangerous objects; adults may commit to a relationship after only a brief acquaintance or take a job or enter into a business arrangement without doing due diligence)" .
The aim of this study was to investigate the psychometric properties of the proposed ADHD symptoms in DSM-V. In the first step, factor analyses were conducted to assess the loadings for the symptoms. Then, the convergent and discriminative validity of the categories of inattentiveness and hyperactivity-impulsivity of DSM-V ADHD symptoms were assessed. Finally, the internal reliability of the inattentiveness and hyperactivity- impulsivity was calculated.
106 children, who were consecutive referrals to a university affiliated Child and Adolescent Psychiatry Clinic in Shiraz, Iran, participated in this study. All of the children and adolescents were interviewed face to face by a board certified Child and Adolescent psychiatrist. In addition, at least one of their parents or caregivers was interviewed face to face as a collateral information resource.
The Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, DSM-IV diagnostic criteria was used to make psychiatric diagnoses . Interviews were conducted according to the Farsi version of the Schedule for Affective Disorders and Schizophrenia for School-Age Children .
Parents reported ADHD symptoms by completing the ADHD checklist of child symptom inventory-4 [14–16]. The ADHD checklist of child symptom inventory-4 includes 18 symptoms. The symptoms are categorized into two groups of inattentiveness and hyperactive/impulsivity symptoms. The inattentiveness symptoms category consists of 9 symptoms according to DSM-IV. The category of hyperactive/impulsivity symptoms consists of 9 symptoms according to DSM-IV as well. In fact, the symptoms are the DSM-IV diagnostic criteria. There is a 5-point Likert response scale for the symptoms. The responses ranged from "never," "sometimes," "often," to "almost always". Scores 0 and 1 were assigned to the categories of "never" and "sometimes", respectively. The categories of "often" and "almost always" were assigned to 2 and 3, respectively. The range of scoring for each of inattentiveness and hyperactivity-impulsivity categories was from 0 to 9. The Farsi version of this checklist has enough reliability, convergent and discrimination validity  and has been used in many studies [17–19]. The internal reliability of this checklist for ADHD-inattentive type, ADHD-Hyperactive impulsive type, and combined type of ADHD is 0.81, 0.85, and 0.83, respectively .
The four new items proposed by DSM-V to be added to ADHD diagnostic criteria were translated into Farsi and back translated into English by a bilingual child and adolescent psychiatrist and a psychologist. Every effort was made to preserve the concept of each symptom. After a pilot study on children referred to the clinic, the final version was used in the current study. The responses to these symptoms were in the Likert scale ranging from "never," "sometimes," "often," to "almost always".
The children and parents or caregivers gave their assent or informed written consent for voluntary participation in this study. This study was approved by the Ethics Committee of Shiraz University of Medical Sciences.
SPSS statistical software was used to analyze the data. A factor analysis with varimax rotation was conducted to examine the factor structure of the ADHD DSM-V symptoms. The Kaiser-Meyer-Olkin Measure and the Bartlett's test of sphericity were conducted. Internal consistency was examined using Cronbach's tests.
One-, two-, three-factor models of confirmatory factor analysis were also conducted using LISREL 8.54 software. The convergent and discriminative validity of ADHD symptoms were analyzed using Pearson's r correlation coefficient.
Another factor analysis was also conducted including the four newly proposed symptoms to examine item loading of the 13 symptoms of DSM-V derived hyperactivity- impulsivity symptoms. Here, the symptoms of inattentiveness were not included in the analysis. This analysis was conducted to examine whether the 13 items could be divided into two categories of hyperactivity and impulsivity.
Another factor analysis was conducted including the DSM-IV derived inattentiveness symptoms and the four new symptoms proposed in DSM-V. The symptoms of hyperactivity-impulsivity of DSM-IV were not included.
The sample included 84 (79.2%) boys and 22 (20.8%) girls. The age range of the children and adolescents was 5.5 to 17years. Their mean age was 9.1(SD = 2.5) years.
The Kaiser-Meyer-Olkin Measure was 0.76. It shows the adequacy of sampling. The Bartlett's test of sphericity was less than 0.001. These results indicate that the data are suitable for factor analysis. The factor loading of the principal component analysis is indicated in Table 1. The factor of Hyperactivity-Impulsivity explained 30.4% (eigenvalue = 6.7) of the total variance. The factor of Inattentiveness accounted for 12.1% (eigenvalue = 2.6). Nearly all of the symptoms of inattentiveness were loaded in one factor. All of the Hyperactivity-Impulsivity symptoms were loaded on another factor. Three out of the four newly proposed ADHD separate symptoms were loaded on the factor including inattentiveness symptoms.
In order to test which of the various models gives the best fit to the data, three confirmatory factor analyses were conducted. A one-factor model was not a good fit (Chi- square = 384.65, df = 209, P value 0.0001, Root Mean Square Error of Approximation (RMSEA) = 0.098, Non-normed Fit index (NNFI) = 0.96, Comparative Fit index = 0.96.).
A two-factor model fit well. The results of two-factor model confirmatory factor analysis showing the correlation between inattentiveness and hyperactivity/impulsivity factors that was .56 are displayed in Table 2.
However, a three-factor model of confirmatory factor analysis also fit well and it was better than the two-factor model (Table 3).
The factor loading of the second component analysis including only the symptoms of hyperactivity-impulsivity of DSM-V is displayed in Table 4. The Kaiser-Meyer-Olkin Measure was 0.83. Bartlett's test of sphericity was less than 0.001. It shows that all of the symptoms of the ADHD DSM-IV derived are loaded in one factor. Meanwhile, the four new symptoms proposed in DSM-V are loaded in another factor.
The principal component analysis including the DSM-IV derived inattentiveness symptoms and the four new symptoms proposed in DSM-V indicated the two factor loading (Table 5). This analysis indicates that all of the inattentiveness symptoms are loaded in one factor and the new symptoms proposed in DSM-V are loaded in another factor.
The convergent and discriminative validity for the whole 22 symptoms proposed for ADHD in DSM-V were calculated. The range of convergent validity for the symptoms of inattentiveness was from 0.504 to 0.772 and that of discriminative validity for the symptoms of inattentiveness was from 0.017 to 0.427. Also, the range of convergent validity for the symptoms of hyperactivity-impulsivity was from 0.42 to 0.770 and that of discriminative validity for the symptoms of hyperactivity-impulsivity was from 0.12 to 0.39.
The alpha coefficient for the whole 24 symptoms of ADHD in DSM-V was 0.88. The alpha for the DSM-V hyperactivity-impulsivity was 0.87. It was 0.80 for DSM-IV inattention.
To the best of the author's knowledge, this is the first study investigating psychometric and factor structure of ADHD DSM-V derived symptoms. So, it is not possible to compare the current results with those of other studies. Confirmatory factor analysis confirmed the proposed two-factor loading of inattentiveness and hyperactivity/impulsivity for the new ADHD DSM-V criteria. However, the three-factor model of confirmatory factor analysis showed that the four new items can be considered as the third factor.
The results indicate that convergent and discriminative validity for ADHD DSM-V derived inattention symptoms are sufficient. Although the symptoms of hyperactivity- impulsivity are discriminated from inattentiveness symptoms, the convergent validity of the four newly proposed symptoms in DSM-V is not as high as that of the 9 symptoms derived from DSM-IV. The three new criteria for hyperactivity/impulsivity were loaded in inattentiveness factor rather than in hyperactivity-impulsivity factor. These may not support the fact that the 4 proposed symptoms for revision of ADHD exactly describe hyperactivity-impulsivity symptoms. However, the internal consistency and reliability of the inattentiveness and hyperactive/impulsivity symptoms are high.
Considering the factor loading of the four newly proposed symptoms added to DSM-V, there is a concern that inattentiveness symptoms may falsely increase the diagnosis of ADHD-hyperactive/impulsive type or combined type of ADHD. It means that the symptoms which are loaded as inattentive symptoms may lead to subthreshold ADHD- hyperactive/impulsive type using DSM-IV, while fulfilling criteria of ADHD- hyperactive/impulsive type using DSM-V.
With respect to the fact that the better diagnoses and classification of children with ADHD could lead to a better treatment, more discussion and justification about the new items are required. Probably, future studies should investigate the neuropsychological functioning of children with ADHD for the classification of the subtypes of ADHD. The current results indicated that continued research is required to reach accurate diagnostic criteria for making accurate ADHD diagnoses.
There is some overlap between ADHD symptoms and ODD in DSM-IV . ODD symptoms are properly differentiated from ADHD. However, two items of the ADHD including "Often has trouble organizing activities" and "Often runs about or climbs when and where it is not appropriate" are loaded in the oppositional defiant disorder component rather than ADHD component . Another concern is whether the new added symptoms in DSM-V are well differentiated from ODD symptoms. This needs further studies.
There are some limitations in this study which need to be considered. This study was conducted on a clinical sample of children and adolescents with ADHD. Further studies with larger sample size including community sample with a wider age rage are recommended. The children and their parents were the sources of information. Including other informants such as teachers is also recommended. This study is based on one sample in a specific geographical area. In addition, the use of translation instead of the actual questionnaire is another limitation. A multi-site approach with a more limited age range would be required to appropriately assess the psychometric properties of the proposed items of a classification used worldwide.
Despite the above-mentioned limitations, this is the first study that assesses psychometric properties of ADHD DSM-V derived symptoms. In addition, the children, adolescents and parents were interviewed face to face using a well known semi- structured interview. Moreover, all the interviews were conducted by a Board-certified child and adolescent psychiatrist.
The findings of present study support the two-factor model of the DSM-V ADHD diagnostic criteria including inattentiveness and hyperactivity/impulsivity. Nevertheless, the four new items can be considered as a third factor.
Rohde LA: Is there a need to reformulate attention deficit hyperactivity disorder criteria in future nosologic classifications?. Child Adolesc Psychiatr Clin N Am. 2008, 17 (2): 405-420. 10.1016/j.chc.2007.11.007.
Ghanizadeh A: Distribution of symptoms of attention deficit-hyperactivity disorder in schoolchildren of Shiraz, south of Iran. Arch Iran Med. 2008, 11 (6): 618-624.
Bell AS: A Critical Review of ADHD Diagnostic Criteria: What to Address in the DSM-V. J AttenDisord. 2010
Ghanizadeh A: Is it time to revise the definition of attention deficit hyperactivity disorder?. Ann Acad Med Singapore. 2010, 39 (2): 155-156.
Swanson JM, Wigal T, Lakes K: DSM-V and the future diagnosis of attention- deficit/hyperactivity disorder. Curr Psychiatry Rep. 2009, 11 (5): 399-406. 10.1007/s11920-009-0060-7.
Ramtekkar UP, Reiersen AM, Todorov AA, Todd RD: Sex and age differences in attention- deficit/hyperactivity disorder symptoms and diagnoses: implications for DSM-V and ICD-11. J Am Acad Child Adolesc Psychiatry. 2010, 49 (3): 217-228. e211-213
Milich R, Balentine AC, Lynam DR: ADHD combined type and ADHD predominantly inattentive type are distinct and unrelated disorder. Clinical Psychology: Science and Practice. 2001, 8: 463-488. 10.1093/clipsy.8.4.463.
Poulton AS: Time to redefine the diagnosis of oppositional defiant disorder. J Paediatr Child Health. 2010
Ghanizadeh A: Should ADHD broaden diagnostic classification to include oppositional defiant disorder?. Journal of Paediatrics and Child Health. 2011, 47 (6): 396-397.
Polanczyk G, Caspi A, Houts R, Kollins SH, Rohde LA, Moffitt TE: Implications of extending the ADHD age-of-onset criterion to age 12: results from a prospectively studied birth cohort. J Am Acad Child Adolesc Psychiatry. 2010, 49 (3): 210-216.
DSM-5 development. [http://www.dsm5.org/ProposedRevisions/Pages/proposedrevision.aspx?rid=383]
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 1994, Washington, DC: American Psychiatric Association, Fourth
Ghanizadeh A, Mohammadi MR, Yazdanshenas A: Psychometric properties of the Farsi translation of the Kiddie Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version. BMC Psychiatry. 2006, 6: 10-10.1186/1471-244X-6-10.
Ghanizadeh A, Jafari P: Cultural structures of the Persian parents' ratings of ADHD. J Atten Disord. 2010, 13 (4): 369-373. 10.1177/1087054709332421.
Studying of Validity, Reliability, and Cutoff points of CSI-14 in the School Children Aged 6 to 14 in Tehran. Tehran Exceptional students' Research Center. Edited by: Alipour A, Esmaile EM. 2004
Sprafkin J, Gadow KD, Salisbury H, Schneider J, Loney J: Further evidence of reliability and validity of the Child Symptom Inventory-4: parent checklist in clinically referred boys. J Clin Child Adolesc Psychol. 2002, 31 (4): 513-524.
Ghanizadeh A, Mohammadi MR, Moini R: Comorbidity of psychiatric disorders and parental psychiatric disorders in a sample of Iranian children with ADHD. J Atten Disord. 2008, 12 (2): 149-155.
Ghanizadeh A: Psychiatric comorbidity differences in clinic-referred children and adolescents with ADHD according to the subtypes and gender. J Child Neurol. 2009, 24 (6): 679-684. 10.1177/0883073808331086.
Ghanizadeh A, Khajavian S, Ashkani H: Prevalence of psychiatric disorders, depression, and suicidal behavior in child and adolescent with thalassemia major. J Pediatr Hematol Oncol. 2006, 28 (12): 781-784. 10.1097/01.mph.0000243665.79303.9e.
Ghanizadeh A: Overlap of ADHD and oppositional defiant disorder DSM-IV derived criteria. Arch Iran Med. 2011, 14 (3): 179-182.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/12/21/prepub
The author thanks Zahra Bagheri for performing the confirmatory factor analysis and Dr. NasrinShokrpour for editing the manuscript.
The authors declare that they have no competing interests.
All authors read and approved the final manuscript.
About this article
Cite this article
Ghanizadeh, A. Psychometric analysis of the new ADHD DSM-V derived symptoms. BMC Psychiatry 12, 21 (2012). https://doi.org/10.1186/1471-244X-12-21