Skip to main content
  • Research article
  • Open access
  • Published:

Evaluation of the diagnostic implications of Das-Naglieri cognitive assessment system in children with attention deficit hyperactivity disorder

Abstract

Background

Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental characterized by attention deficit, hyperactivity, emotional impulses and difficulty with cognitive functions. The Das-Naglieri Cognitive Assessment System (DN: CAS), as a theory-driven assessment kit, was explored based on Planning, Attention, Simultaneous, and Successive Theory (PASS). Recent researches have tried to explore the sensitivity and specificity of DN: CAS in diagnosing ADHD; nevertheless, these studies were performed in a small study population. The following study explores the cognitive functions in ADHD by the DN: CAS and to evaluate the DN: CAS’s diagnostic value in ADHD.

Methods

A total of 135 children with ADHD and 140 healthy controls were enrolled to evaluate cognitive function by the DN: CAS. ROC curve and the area under the curve (AUC) were applied to evaluate the diagnostic value of DN: CAS on ADHD.

Results

Compared with healthy controls, children with ADHD had significantly lower scores in Planning, Simultaneous (Verbal-Spatial Relations), Attention in the four Subtests of DN: CAS, as well as the total scores. ROC analysis indicated that Planning and Attention of DN: CAS had good classification accuracy in diagnosing ADHD with AUCs of 0.808 and 0.730, respectively.

Conclusions

The planning and attention assessment of DN: CAS revealed high sensitivity and specificity in diagnosing ADHD, thus suggesting that DN: CAS might be an effective tool in diagnosing ADHD.

Peer Review reports

Background

In China, approximately 4.31–5.83% of children are affected by ADHD, which is a neurodevelopmental disorder characterized by attention deficit, hyperactivity, emotional impulses and difficulty with cognitive functions [1, 2]. The American Academy of Child & Adolescent Psychiatry noted that the assessments for ADHD may include structured diagnostic interviews, parent and teacher report behavior rating scales, direct observations by doctor and cognitive tests. As cognitive neuroscience advances, most studies seem to demonstrate that the impairment of cognitive function is an important manifestation in ADHD [3,4,5]. Barkley constructed a theoretical model indicating that ADHD may be linked to four executive neuropsychological function impairments in 1997 [6]. These theories provided the basis for clinical diagnosis of ADHD and many cognitive assessment tools were used to evaluate the clinical symptoms of ADHD such as CPT test, Stroop test and Go/No Go task [7,8,9,10].

The Das-Naglieri cognitive assessment system (DN: CAS), as a theory-driven assessment kit, was explored based on PASS theory by JP. Das, which was applied to assess the cognitive function. PASS theory has reconceptualized intelligence as a process-driven understanding of cognitive abilities based on the following four cognitive processes: Planning, Attention, Simultaneous and Successive processing [11]. This theory has been linked to Luria’s three functional units of the brain. Attention has been linked to the first structural unit, i.e. brain stem, midbrain and the brain; Simultaneous and Successive processing have been linked to the second structural unit, i.e. occipital, temporal, and parietal lobes; Planning has been linked with the third structural unit, i.e. the frontal lobe, and especially the prefrontal lobe in the same direction [12]. In his study, McCrea has reported on three patients with unilateral focalized stroke lesions that were examined longitudinally on the DN: CAS, suggesting that the DN: CAS subtests are not only unique but also sensitive and specific to focalized cortical lesions [13].

PASS theory, which is similar to Barkley’s execution function defect theory, proposes that children with ADHD may be more impulsive in cognitive processing, which in turn can influence planning processing. Attention difficulties are expected to negatively affect attention processing. Some studies have demonstrated that children with ADHD assessed by DN: CAS have the lowest performance on Planning and Attention scores, whereas their Simultaneous and Successive processing scores appear normal [14, 15]. DN: CAS has been standardized in different languages including Chinese [16].

ADHD is a multifactorial disorder, and genetic factors might be associated with the risk of ADHD [17, 18]. Given the different genetic background, the aim of the present study was to explore the association of cognitive functions and ADHD, and to evaluate the DN: CAS’s diagnostic value in Chinese children with ADHD.

Methods

Study population

A total of 135 children with ADHD and 140 controls were recruited in this study. The ADHD children were enrolled from People’s hospital of Guangxi Zhuang Autonomous Region between Jan 2015 and Dec 2016. In addition, 140 healthy controls were enrolled from the same communities and schools. All study subjects were interviewed by two well-trained investigators at the Department of Psychiatry, who used K-SADS to conduct interview. ADHD was diagnosed according to American Psychiatric Association (APA) criteria (Diagnostic and statistical manual of mental disorders, 5th edition (DSM-5)). Medical history, clinical examination and APA diagnosis criteria evaluated by two independent psychiatrists were used to identify healthy controls as free of ADHD. Children with Intellectual Disability (The Full Scale IQ (FSIQ) < 85 by WISC-CR-II), Learning Disorder, Tic Disorders and Autism spectrum disorder were excluded from the study. The FSIQ was included in the present study.

The Ethics Committee of People’s hospital of Guangxi Zhuang autonomous Region approved this study, and all study subjects agreed to participate in our research after they were debriefed about the study and after they signed the informed consent; for the children under 16-years of age, the consent was obtained from their guardians.

Instrument

DN:CAS Chinese version

The DN: CAS [16] was administered by a well-trained psychotherapist. This assessment tool includes four subscales, including Planning, Attention, Simultaneous Processing, and Successive Processing. The whole test is made up of 12 subtests, with each subscale containing three items. Two different sets of tests were carried out according to various age groups (5–7 year-olds and 8–17 year-olds).

Planning assessment was used to evaluate the efficiency in task solving, including Matching Numbers, Planned Codes and Planned Connections. Matching Numbers requires the test taker to find two identical numbers in the same row (e.g. find 2 identical numbers in a row such as 3–5–2-6-5-7-4). Arrangement in each row is well-designed in order to detect the benefit of the matching strategy during differentiation. Planned Codes require the test taker to code characters arranged in specific order with certain strategy, based on the way they’ve been previously thought (e.g. Codes for A, B and C are OX, XX, and XO, separately. The subject needs to convert a series of characters into corresponding codes). Planned Connections require the subject to connect randomly scattered numbers/numbers and letters in numerical or/and alphabetical order (e.g. 1–2–3-4/1-A-2-B-3-C).

Attention mainly assesses the ability to selectively focus on one part of the two-dimensional stimulus while ignoring the other part, including Expressive Attention, Number Detection and Receptive Attention. Expressive Attention refers to the ability to inhibit interfering stimuli in the procedure of expression (e.g. test taker is presented with cards containing the color names printed in colors that are different from the meaning of the printed word, and then the test taker is asked to say the color of the word instead of the word itself). Number Detection evaluates selective attention, switching attention and cognitive inhibition to distraction (e.g. test taker is presented with 3–6 targeted numbers together with several rows of numbers from 0 to 9 in the item, and then he/she is asked to find and underline figures that look exactly the same as targeted ones, from left to right in a row). Receptive Attention requires the subject to circle every pair of characters that look the same or that have the same pronunciation (e.g. circle AA but not AB, and circle Tt but not Tb).

Simultaneous processing requires the test taker to interconnect components of special items to get the correct answer. It includes Nonverbal Matrices, Verbal-Spatial Relations and Figure Memory. The test taker needs to figure out relation among the segments in the item, then to integrate them with abstract thinking and logical perception ability. There are three types of items in Nonverbal Matrices, i.e. graph filling, analogical reasoning and spatial vision. Each item contains graphs and geometrical elements with relations to either spatial organization or logical organization, and the subject reveals abstract reasoning by observing these relations (e.g. he/ she is asked to make a deduction and find out the absent figure based on the relationship among the five figures presented). In Verbal-Spatial Relations, the subject needs to choose a corresponding picture after he/she is given the description with underlying logical relationship (e.g. subject is presented with six pictures showing various spatial relationships between a ball and a desk, and asked to point out the correct picture). Figure Memory is a representative subtest of simultaneous processing. It includes two-dimensional or three-dimensional figures that are shown to subject, who is then asked to discriminate the simple figure from a complex one (e.g. subject is presented with a simple geometric figure for 5 s, which is then removed and the subject is asked to draw it).

Successive Processing requires individuals to replicate a particular event or sequence of events. It contains Word Series, Sentence Repetition and Sentence Questions. In this subscale, the subject needs to understand or repeat auditory information that is presented in specific order. The Word Series is made up of monosyllabic words (e.g. dog, pen, and book) whose length ranges from 2 to 9 alphabets. The administrator reads them in a speed of 1 s/alphabet and asks the subject to repeat in the same order. The Sentence Repetition requires for a duplication of the auditory sentence that is made up of color items and with no actual meaning (e.g. red is black). The Sentence Questions are used to evaluate the subject’s understanding of the grammatical relations in the sentence by letting the subject to answer a question based on the stated sentence (e.g. ‘White is blue. What is blue?’ answer ‘white’).

Calculate raw scores in the 12 subtests separately, then convert them to scale scores. After that, add up the scale scores in each subscale and convert them to standardized scores.

Statistical analysis

Continuous variables were shown as the mean value ± SD. Normal distribution of data was analyzed using the Kolmogorov–Smirnov normality test. Data with normal distribution were compared by Student’s t test and bonferroni correction. Those with unequal variance or without a normal distribution were analyzed by a Mann–Whitney rank sum test. Items of DN: CAS and FSIQ were compared by Student’s t test, and statistical analyses were carried out using statistical analysis software package SPSS19.0 with the level of significance at p < 0.05.

ROC curve was used to measure classification performance (sensitivity and specificity) for the DN: CAS and statistical analyses were carried out using statistical analysis software MedCalc15.8 with the level of significance at p < 0.05.

Results

Characteristics of study population

The general characteristics of the ADHD and control group are presented in Table 1; there were not significant differences of age, gender and grade between ADHD group and control group. Comparing to control group children with ADHD had significantly lower scores in FSIQ.

Table 1 The general characteristics of Study Population

The DN:CAS assessment of the ADHD and control group

In this study, children with ADHD had significantly lower scores in these subtests compared to control group: Planning (T = − 10.260, p < 0.01), Simultaneous (T = − 2.406, p < 0.05), Attention (T = − 7.075, p < 0.01) of DN:CAS, while the total scores were also statically lower in ADHD group compared to controls (T = − 7.284, p < 0.01). Compared with control group, ADHD children had worse performance in Matching Numbers (T = − 8.22, p < 0.01), Planned Codes (T = − 5.779, p < 0.01), Planned Connections (T = − 9.124, p < 0.01) of Planning; Verbal-Spatial Relations (T = − 2.278, p < 0.01) of Simultaneous and Expressive Attention (T = − 5.146, p < 0.01); and Number Detection (T = − 6.608,p < 0.01), Receptive Attention (T = − 4.059,p < 0.01) (Table 2). The results showed that there were more cognitive deficits in ADHD group than in healthy subjects, especially in relation to planning and attention of DN: CAS.

Table 2 DN: CAS full scale and subscale means and standard deviations for ADHD groups and Control groups

ROC analyses

Since our results revealed an association between planning and attention deficit and ADHD assessment by DN:CAS, we aimed to investigate the sensitivity and specificity of planning and attention assessment in diagnosing ADHD. The ROC analysis indicated that Planning and Attention assessment had good classification accuracy in ADHD diagnose with AUCs of 0.808 (95%CI: 0.756–0.853, p < 0.01) and 0.730 (95%CI: 0.673–0.782, p < 0.01) respectively. The cutoff point was drawn from the curve for Planning 25-point and for Attention 29-point for diagnostic measures (Table 3 and Fig. 1). Positive predictive value and negative predictive values for Planning were 72.6 and 79.3%; for Attention were 78.5 and 57.9%, respectively.

Table 3 ROC curves and other parameters of Planning and Attention
Fig. 1
figure 1

The ROC Curve of the Planning and the Attention to diagnostic the ADHD ROC analysis indicated that Planning and Attention had good classification accuracy with AUCs of 0.808 (95% CI: 0.756–0.853, p < 0.01) and 0.730 (95% CI: 0.673–0.782, p < 0.01) respectively

Discussion

The diagnosis of ADHD is mainly based on three categories of clinical symptoms, i.e. attention deficit, hyperactivity and impulsivity. Many scholars have tried to find an effective tool for diagnosis of ADHD, and from 1998, continuous performance tests (CPT) have been widely used in the diagnosis of ADHD. The CPT is used to assess attention and control ability [7, 8, 19]. Meanwhile, Go/No Go task is another test tool commonly used for ADHD diagnosis, which focuses on executive function but without assessing other cognitive functions [10]. Thus, the use of these tools has certain limitations in diagnosing ADHD and in evaluating the cognitive deficit in ADHD. The DN: CAS, a well-admissive theory-driven assessment kit consisting of four independent factors, which include Planning, Attention, Simultaneous and Successive processing in the PASS model, have been used to assess neurodevelopmental disorder in 5–17 year old children [15, 20]. To the best of our knowledge, the DN: CAS is the most comprehensive tool for assessment of cognitive processes, which is why we aimed to explore the association between ADHD diagnosis and the DN: CAS assessment.

Our results demonstrated that the ADHD gender incidence was 4.9 (112 boys): 1(23 girls), which was consistent with previous studies [1]. We found that ADHD children performed significantly worse in FSIQ and Planning including Matching Numbers, Planned Codes, Planned Connections; and Attention including Expressive Attention, Number Detection and Receptive Attention, which was consistent with the majority of recent researches [16, 20, 21]. According to PASS theory, Planning represents the ability to perform decision-making, selection and implementation, thanks to the corresponding brain regions that are located in frontal cortex [13, 22]. We found that ADHD subjects exhibited Planning defects in DN: CAS assessment, which was stated as EF impairment in Barkley’s theoretical model [6]. While Attention subtests require a sustained focus for identification of a target stimulus, our study revealed the ADHD children had a weaker performance in the Attention compared to healthy children. In addition, compared with control subjects, ADHD children scored worse in Verbal-Spatial Relations of Simultaneous, which was inconsistent with previous studies [14, 16]. According to PASS theory, Simultaneous is a cognitive process by which the individual integrates separate stimuli into a single group, and Simultaneous requires the children to understand logical-grammatical relationships [20]. Our results indicated that ADHD subjects might have deficit in Simultaneous processing of Verbal-Spatial reasoning.

Since the ADHD children appeared to have obvious defects in DN: CAS assessment, especially in planning and attention, ROC analysis was applied to evaluate the sensitivity and specificity of planning and attention assessment in diagnosing ADHD. The AUC of Planning was 0.808 when the cut-off point was set at 25-points, where the sensitivity was 72.6% and specificity was 79.3%; the AUC of Attention was 0.730, when the cut-off point was set at 29-points, where the sensitivity was 78.5% and specificity was 57.9%. The obtained results indicated that the planning and attention assessment of DN: CAS had high sensitivity and specificity in diagnosing ADHD, which suggested that DN: CAS might be an effective tool for diagnosing ADHD, especially in a clinical setting. This study also provided a useful indication for the treatment of ADHD by using remedial programmers; their specific focus will be the amelioration of EF deficit.

Limitation

This study had some limitations. First, selection bias might exist in enrollment; Secondly, we recruited the ADHD cases without any comorbidities in order to reduce the possible bias from study subject’s stratification, we need to enlarge the study population of ADHD in the future; thirdly, larger sample needed to be carried out to verify the diagnostic value of DN:CAS in ADHD diagnosis.

Conclusion

The planning and attention assessment of DN: CAS had highly sensitivity and specificity in diagnosing ADHD, which was encouraged that DN: CAS might be an effective tool in diagnosing ADHD.

Abbreviations

ADHD:

attention deficit hyperactivity disorder

APA:

American Psychiatric Association criteria

CPT:

continuous performance tests

DN: CAS:

Das-Naglieri cognitive assessment system

DSM-5:

Diagnostic and statistical manual of mental disorders 5th edition

FSIQ:

Full Scale IQ

PASS:

Planning, Attention, Simultaneous, and Successive Theory

References

  1. Faraone SV, Sergeant J, Gillberg C, Biederman J. The worldwide prevalence of ADHD: is it an American condition? World Psychiatry. 2003;2(2):104–13.

    PubMed  PubMed Central  Google Scholar 

  2. Polanczyk GV, Willcutt EG, Salum GA, Kieling C, Rohde LA. ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. Int J Epidemiol. 2014;43(2):434–42.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Tillman CM, Bohlin G, Sorensen L, Lundervold AJ. Intellectual deficits in children with ADHD beyond central executive and non-executive functions. Arch. Clin. Neuropsychol. 2009;24(8):769–82.

    Article  PubMed  Google Scholar 

  4. Velez-van-Meerbeke A, Zamora IP, Guzman G, Figueroa B, Lopez Cabra CA, Talero-Gutierrez C. Evaluating executive function in schoolchildren with symptoms of attention deficit hyperactivity disorder. Neurologia (Barcelona, Spain). 2013;28(6):348–55.

    Article  CAS  Google Scholar 

  5. Berenguer Forner C, Rosello Miranda B, Baixauli Fortea I, Garcia Castellar R, Colomer Diago C, Miranda Casas A. ADHD symptoms and peer problems: mediation of executive function and theory of mind. Psicothema. 2017;29(4):514–9.

    PubMed  Google Scholar 

  6. Barkley RA. Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychol Bull. 1997;121(1):65–94.

    Article  PubMed  Google Scholar 

  7. Krieger V, Amador-Campos JA. Assessment of executive function in ADHD adolescents: contribution of performance tests and rating scales. Child Neuropsychol. 2017:1–25.

  8. Lundervold AJ, Stickert M, Hysing M, Sorensen L, Gillberg C, Posserud MB. Attention deficits in children with combined autism and ADHD: a CPT study. J Atten Disord. 2016;20(7):599–609.

    Article  PubMed  Google Scholar 

  9. Sorensen L, Plessen KJ, Adolfsdottir S, Lundervold AJ. The specificity of the Stroop interference score of errors to ADHD in boys. Child Neuropsychol. 2014;20(6):677–91.

    Article  CAS  PubMed  Google Scholar 

  10. Newman E, Jernigan TL, Lisdahl KM, Tamm L, Tapert SF, Potkin SG, Mathalon D, Molina B, Bjork J, Castellanos FX, et al. Go/no go task performance predicts cortical thickness in the caudal inferior frontal gyrus in young adults with and without ADHD. Brain Imaging Behav. 2016;10(3):880–92.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Perez-Alvarez F, Timoneda-Gallart C. PASS neurocognitive dysfunction in attention deficit. Rev Neurol. 2001;32(1):30–7.

    CAS  PubMed  Google Scholar 

  12. Deilami M, Jahandideh A, Kazemnejad Y, Fakour Y, Alipoor S, Rabiee F, Pournesaie GS, Heidari RN, Mosavi SA. The effect of neurofeedback therapy on reducing symptoms associated with attention deficit hyperactivity disorder: a case series study. Basic Clin Neurosci. 2016;7(2):167–71.

    PubMed  PubMed Central  Google Scholar 

  13. McCrea SM. A cognitive neuropsychological examination of the Das-Naglieri cognitive assessment system subtests: a report of three stroke cases studied longitudinally during recovery. Int J Neurosci. 2009;119(4):553–99.

    Article  PubMed  Google Scholar 

  14. Van Luit JE, Kroesbergen EH, Naglieri JA. Utility of the PASS theory and cognitive assessment system for Dutch children with and without ADHD. J Learn Disabil. 2005;38(5):434–9.

    Article  PubMed  Google Scholar 

  15. Nakashima N, Yamashita Y, Hirata R, Nagamitsu S, Matsuishi T. Kana reading disability and Das-Naglieri cognitive assessment system findings in children with attention deficit hyperactivity disorder. Pediatri Int. 2012;54(6):849–53.

    Article  Google Scholar 

  16. Deng CP, Liu M, Wei W, Chan RC, Das JP. Latent factor structure of the Das-Naglieri cognitive assessment system: a confirmatory factor analysis in a Chinese setting. Res Dev Disabil. 2011;32(5):1988–97.

    Article  PubMed  Google Scholar 

  17. Kuntsi J, Pinto R, Price TS, van der Meere JJ, Frazier-Wood AC, Asherson P. The separation of ADHD inattention and hyperactivity-impulsivity symptoms: pathways from genetic effects to cognitive impairments and symptoms. J Abnorm Child Psychol. 2014;42(1):127–36.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Tannock R. Attention deficit hyperactivity disorder: advances in cognitive, neurobiological, and genetic research. J Child Psychol Psychiatry. 1998;39(1):65–99.

    Article  CAS  PubMed  Google Scholar 

  19. Mesquita C, Nazar BP, Pinna CM, Rabelo B, Serra-Pinheiro MA, Sergeant J, Mattos P. How can continuous performance test help to assess inattention when mood and ADHD symptoms coexist? Psychiatry Res. 2016;243:326–30.

    Article  PubMed  Google Scholar 

  20. Naglieri JAGS, Iseman JS. Schwebach.: performance of children with attention deficit hyperactive disorder and anxiety/depresión on the WISC-III and cognitive assessment system (CAS). J Psychoeduc Assess. 2003;21:32–43.

    Article  Google Scholar 

  21. Canivez GL, Gaboury AR. Construct validity and diagnostic utility of the cognitive assessment system for ADHD. J Atten Disord. 2016;20(6):519–29.

    Article  PubMed  Google Scholar 

  22. Posner J, Siciliano F, Wang Z, Liu J, Sonuga-Barke E, Greenhill L. A multimodal MRI study of the hippocampus in medication-naive children with ADHD: what connects ADHD and depression? Psychiatry Res. 2014;224(2):112–8.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

None.

Funding

This work was supported by the Scientific Research and Technology Development Program of Guangxi (1355005–5-5).

Availability of data and materials

The datasets used and analyze during the study are available from the corresponding author on reasonable request.

Declarations

This work was supported by the Scientific Research and Technology Development Program of Guangxi (1355005–5-5), and no other relationships/conditions/circumstances that present potential conflict of interest.

Author information

Authors and Affiliations

Authors

Contributions

Conception and design of the study: LQ and HRL. Data acquisition: HZ, YHF, DDL Data management and analysis: HRL. Manuscript drafting/editing: HRL. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hairun Liu.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of People’s hospital of Guangxi Zhuang autonomous Region has approved this study, all study subjects were agreed to participate in our research after fully explanation and signed the informed consent, while the children under 16-year old were gained the consent from their parents. (1355005–5-5).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qin, L., Liu, H., Zhang, H. et al. Evaluation of the diagnostic implications of Das-Naglieri cognitive assessment system in children with attention deficit hyperactivity disorder. BMC Psychiatry 18, 386 (2018). https://doi.org/10.1186/s12888-018-1970-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-018-1970-x

Keywords