Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Linear and non-linear analyses of Conner’s Continuous Performance Test-II discriminate adult patients with attention deficit hyperactivity disorder from patients with mood and anxiety disorders

BMC Psychiatry volume 16, Article number: 284 (2016) Cite this article

Abstract

Background

Attention Deficit Hyperactivity Disorder (ADHD) is a heterogeneous disorder. Therefore it is important to look for factors that can contribute to better diagnosis and classification of these patients. The aims of the study were to characterize adult psychiatric out-patients with a mixture of mood, anxiety and attentional problems using an objective neuropsychological test of attention combined with an assessment of mood instability.

Method

Newly referred patients (n = 99; aged 18–65 years) requiring diagnostic evaluation of ADHD, mood or anxiety disorders were recruited, and were given a comprehensive diagnostic evaluation including the self-report form of the cyclothymic temperament scale and Conner’s Continuous Performance Test II (CPT-II). In addition to the traditional measures from this test we have extracted raw data and analysed time series using linear and non-linear mathematical methods.

Results

Fifty patients fulfilled criteria for ADHD, while 49 did not, and were given other psychiatric diagnoses (clinical controls). When compared to the clinical controls the ADHD patients had more omission and commission errors, and higher reaction time variability. Analyses of response times showed higher values for skewness in the ADHD patients, and lower values for sample entropy and symbolic dynamics. Among the ADHD patients 59 % fulfilled criteria for a cyclothymic temperament, and this group had higher reaction time variability and lower scores on complexity than the group without this temperament.

Conclusion

The CPT-II is a useful instrument in the assessment of ADHD in adult patients. Additional information from this test was obtained by analyzing response times using linear and non-linear methods, and this showed that ADHD patients with a cyclothymic temperament were different from those without this temperament.

Peer Review reports

Background

Attention Deficit Hyperactivity Disorder (ADHD) is a heterogeneous disorder [1] and subgrouping traditionally occurs according to symptoms that follow DSM-criteria [2]. However, it is important to look for other factors that can contribute to a better understanding of the biological basis of this disorder [3]. Mood instability may be one such factor, and although it is not one of the core criteria of ADHD it is an important clinical characteristic [4] of these patients. This may represent a possible link to bipolar spectrum disorders [5], that include bipolar I, bipolar II, cyclothymia and cyclothymic temperament [6]. The cyclothymic temperament (CT) is characterized by mood instability, with intermittent cycles with rapid oscillations between elevated and depressed mood that characterize the habitual functioning of the individual, and is present since at least early adulthood [7]. This temperament, defined according to the criteria of Akiskal et al. [8, 9], is common in adult ADHD patients [6]. Positive scores on a self-evaluation form for this temperament separates a subgroup of ADHD patients with higher scores on ADHD symptom scales, a higher frequency of psychiatric symptoms, including drug and alcohol abuse, and more impairment, reflected in lower education and a reduced chance of being employed [6].

The diagnosis of ADHD is based on symptoms and behavioural criteria [2], but neuropsychological tests, such as continuous performance tests, are often employed in the assessment [10]. The Conner’s Continuous Performance Test (CPT) is one such test, however opinions differ as to how useful it is in the assessment of patients presenting for evaluation of ADHD symptoms [11–13].

The CPT uses several different measures to characterize the response patterns, one of them being variability. In neuropsychological tests ADHD patients are characterized by increased intraindividual variability of reaction times. One reason for this variability is the presence of some very long response times. In order to investigate this phenomenon further different analysis methods have been used, such as frequency domain analyses and ex-Gaussian analyses [14]. A complementary approach can be to study the complexity of times series [15, 16], employing methods from the field of non-linear systems. In general biological systems can seldom be fully characterized by using simple linear models, and other mathematical tools are usually required, obtained from the field of non-linear systems, complexity theory and chaos theory. Increased order and regularity may be a characteristic feature of diseases affecting different physiological systems [17]. On this background, non-linear methods, such as different measures of complexity and entropy, have in recent years been employed to analyze and evaluate biological time series. These methods are able to give information in addition to that obtained by traditional linear methods [15], and can be used to identify underlying mechanisms of the system being studied, and to predict how the system will change over time. For instance, in cardiology, reduced complexity, measured with approximate entropy and sample entropy, has been found to predict ventricular arrhythmias death [18]. Increased variability and changes in complexity measures have been found in patients with mood disorders using actigraph registrations [15, 19], and depressed patients have shown increased variability of reaction times in a neuropsychological test. We therefore wanted to see if we could find similar changes in ADHD patients with mood instability, defined by the presence of CT.

Thus, in this study we wanted to further characterize the time series from the CPT-II using linear and non-linear methods [15]. Reduced complexity of reaction times in a disorder of attention such as ADHD would be in line with the idea that diseases are characterized by increased order and regularity [17], and our a priori hypothesis was therefore that ADHD patients would show reduced complexity.

The aims of the study have been two-fold, first to characterize an adult population of ADHD patients according to scores on the CPT-second edition (CPT-II) [20], and to compare these patients to a clinical control group, with a mixture of mood, anxiety and attention problems.

Secondly we aimed to examine whether ADHD patients, grouped according to the presence or not of CT, differ in their profile of CPT-II scores.

Method

Ethics statement

The study protocol was approved by the Norwegian Regional Medical Research Ethics Committee West. Written informed consent was obtained from all participants involved in the study.

Subjects

Patients were recruited from the private psychiatric practice of authors KM and WF, both of them certified psychiatrists with long-standing clinical experience. The patients were consecutive new referrals, between 18 and 65 years of age, in need of diagnostic evaluation of ADHD, mood or anxiety disorders.

Exclusion criteria were inability to speak Norwegian and not being able to comply with the study protocol. None were excluded because of inability to speak Norwegian. A total of 104 patients were recruited and 100 of them were tested with CPT-II. One of the patients had been treated with stimulants during testing and was therefore omitted from the analyses, bringing the total number of patients to 99, and these are reported on in the present paper. The group consisted of 48 women and 51 men, with an average age of 37.8 ± 11.0 years (mean ± SD), range 17–61.

74 % of the ADHD patients and 65 % of the clinical controls were not prescribed psychotropic medications. A summary of the drugs used by the patients is presented in Table 1.

Table 1 Psychotropic drug treatment (n, %)
Full size table

After a comprehensive evaluation and consensus discussion, 50 patients fulfilled criteria for a diagnosis of ADHD, while 49 did not. All these 49 patients were given other psychiatric diagnoses, (clinical controls). The gender ratio (male/female) and mean age are similar in the two groups (Table 2).

Table 2 Characteristics of the clinical sample
Full size table

Psychiatric assessment

All diagnostic assessments of the patients were performed by either KM or WF using a clinical interview, supplemented when possible with information from collateral sources (relatives) concerning symptoms of ADHD in childhood. The final diagnostic evaluation assessment was made after an assessment of all available information, and a consensus diagnosis, based on DSM-IV criteria, was made after discussion of each case (KM, WF, OBF and JØB).

The following assessment instruments were employed:

  • The Mini-International Neuropsychiatric Interview (MINI Plus, version 5.0.0), a module based semi-structured interview for DSM-IV and ICD-10 diagnoses, including a module on ADHD symptoms. All the modules except the one on psychotic disorders were administered [21, 22].

  • Wender Utah Rating Scale, 25 questions version (WURS-25), is a 25-item self-rating scale that assesses symptoms and signs of ADHD in childhood, using a scale of 0–4 (0 = never, 4 = very often), yielding a range of scores from 0 to 100. WURS-25 has been used in previous studies in Norway [23].

  • Adult ADHD Self-Report Scale (ASRS). This is the World Health Organization’s rating scale for current symptoms of ADHD in adults. It consists of 18 questions that follow the DSM-IV criteria for ADHD, and uses a 5 point scale of 0–4 (0 = never, 4 = very often), with a range of scores from 0 to 72. The items from 1 to 9 cover symptoms of inattention and the items from 10 to 18 cover hyperactivity and impulsivity [23–25].

  • Hospital Anxiety and Depression Scale (HADS). This is a self-assessment form for detecting current states of depression and anxiety, and has been extensively used, also in Norway [26].

  • The Montgomery-Asberg Depression Rating Scale (MADRS), a standard instrument for the assessment of depression [27].

  • Mood Disorder Questionnaire (MDQ). This is a screening instrument for bipolar disorder that has been validated in both clinical and control populations. It is a self-report form with 13 questions scored “Yes” of “No”. Positive answer to at least 7 questions and confirmation that the symptoms have occurred together and caused problems is suggestive of a bipolar disorder [23, 28].

  • Cyclothymic temperament scale is a self-report form consisting of 21 questions covering the cyclothymic temperament according to the definition of Akiskal [6, 9]. The scale is part of the larger TEMPS-A auto questionnaire [8].

  • Conner’s Continuous Performance Test II (CPT-II) is a computerized test [20] with stimuli consisting of letters presented for 250 msec. The test comprises 360 trials, across six blocks. The time interval (1, 2, or 4 s) between the presented letter varies within each block. Subjects are instructed to press the spacebar for all letters except X, and target and nontarget letters appear randomly. The CCPT-II takes 14 min to complete. The following measures are reported: Reaction time (RT) for correct responses, numbers (%) of omission and commission errors, variability of the standard error, that is the amount of variability the individual shows in the separate segments of the test in relation to the overall standard error and a clinical ADHD Confidence Index score (range 0–100). In addition to these measures, generated by the software supplied by the producer, we have extracted raw data from the test, that is continuous series of 360 reaction times from each patient. Missing data were replaced with the mean of all the other RTs in the series. Patients with more than three successive missing responses were excluded (n = 11; ADHD: n = 8, clinical controls : n = 3). Since we have included information from the CPT-II test in the diagnostic assessment of ADHD this may of course have influenced the association between ADHD and CPT-II measures. We have therefore made separate correlation analyses between scores on the ADHD module of MINI + and CPT-II results.

Mathematical analyses

For the time series raw data we calculated six measures. Linear measures: 1) The mean RT,2) the standard deviation (SD) of RT, expressed as percent of the mean RT, 3) the root mean square successive differences (RMSSD), expressed as percent of the mean RT and 4) skewness. Non-linear measures: 5) sample entropy, 6) symbolic dynamic analysis.

Sample entropy

For the analysis of sample entropy the data were normalized, by transforming the time series to have sample mean 0 and sample variance 1. The software used for the estimation of sample entropy was from the Physio Toolkit Research Resource for Complex Physiologic signals [29], see http://www.physionet.org. Sample entropy is a nonlinear measure, indicating the degree of regularity (complexity) of time series, and is the negative natural logarithm of an estimate of the conditional probability that subseries of a certain length (m) that match point-wise, within a tolerance (r), also match at the next point. We chose the following values, m = 2 and r = 0.2. Sample entropy was employed since it can be employed with comparatively short time series (>50) and is robust with regard to outliers [30].

Symbolic dynamics

The time series were transformed into series of symbols according to the method described by Guzzetti et al. [31] and Porta et al. [32]. The difference between the maximum and minimum value was divided into 6 equal portions (1–6), and each value of the series was assigned a number from 1 to 6, so that the transformed time series consisted of a string of numbers from 1 to 6. To reduce the problem with outliers the maximum value was set at no more than the mean +3 times the SD, and the minimum value to no less than the mean –3 times the SD. The series were then divided into overlapping sequences of three consecutive numbers. The series thus contained 358 such sequences, and the number of different sequences was counted, giving an indication of the complexity of the time series [33]. The maximum number of different sequences for such series will be 216.

Statistics

Student’s t-test was used to evaluate differences between two groups, with the p-value set at 0.05. The Mann–Whitney U test was used when data were not normally distributed. Chi square test was employed when dealing with categorical data. Analysis of variance (ANOVA), with post-hoc Bonferroni corrections were used to compare four groups. We have not used Bonferroni corrections for the other analyses since many of the measures are correlated. Where relevant we have used ANCOVA to adjust for medication (use or no use of medication). There were no interactions with medication use for any of the measures reported. Effect sizes (d) are indicated where relevant. Pearson’s correlation coefficient was employed to evaluate correlations. SPSS version 21 was used for the statistical analyses.

Results

Clinical characteristics

Table 2 shows the clinical characteristics of the two groups. The ADHD group had substantially higher scores on both the WURS-25 (52.0 ± 18.8 vs. 28.9 ± 15.3, p < 0.001, d = 1.34) and ASRS scales 50.0 ± 12.2 vs. 31.6 ± 12.7, p < 0.001, d = 1.48) than the controls. For the questionnaires (HADS, MDQ, CT) and the MADRS scale there were no significant differences between the groups. The clinical diagnoses were based on the MINI+ interview. There was a higher number of patients with anxiety disorders in the group without ADHD (60 % vs. 38 %, p = 0.026). In the ADHD group 62 % did not have an anxiety disorder. For the other diagnoses there were no significant differences between the two groups.

CPT-II performance for ADHD vs. control groups

In Table 3 the results from the CPT-II test are presented. The reaction time was not different for ADHD patients compared to the clinical controls, but the values for omission (3.5 ± 5.0 vs. 0.8 ± 1.1, p < 0.001, d = 0.74) and commission errors ( 55.5 ± 24.2 vs. 35.0 ± 18.6, 9 < 0.001, d = 0.95) and variability (14.9 ± 14.2 vs. 6.6 ± 4.2, p < 0.001, d = 0.79) were all significantly higher in the ADHD group. The ADHD Confidence Index score was also elevated (65.0 ± 21.8 vs. 44.5 ± 20.3, p < 0.001, d = 0.97). Skewness (2.78 ± 2.52 vs. 1.91 ± 2.37, p = 0.011, d = 0.36) and the two variability measures SD (33.1 ± 11.5 vs. 24.0 ± 8.0, p < 0.001, d = 0.93), and RMSSD (40.0 ± 16.2 vs. 28.9 ± 10.8, p < 0.001, d = 0.81) showed higher values in the ADHD patients, combined with lower values for the two complexity measures sample entropy (1.57 ± 0.25 vs. 1.77 ± 0.20, p < 0.001, d = −0.89) and symbolic dynamics (76.6 ± 16.2 vs. 89.0 ± 16. 2, p < 0.001, d = −0.77).

Table 3 Patients with ADHD compared to clinical controls
Full size table

CPT-II performance for ADHD subgroups

The only significant difference between the groups two subgroups of ADHD patients, combined type and inattentive type, was in the reaction time, which was higher in the combined subtype (419 ± 120 vs. 346 ± 58, p = 0.008, d = 0.76). Among the patients with combined type ADHD 17 of 26 (65 %) have positive scores on the CT questionnaire compared to 12 of 23 (52 %) in the inattentive group, but this difference was not significant.

Correlations between CPT-II results and scores on the ADHD adult module of MINI+

Table 4 shows correlations between results from the CPT-II test and sum scores on the ADHD adult module of MINI+ . Concerning the traditional CPT-II results there were significant correlations between ADHD scores and omission errors (0.391, p = < 0.001), commission errors (0.395, p < 0.001), variability (0.330, p = 0.001) and ADHD Confidence Index scores (0.430, p < 0.001). There were significant positive correlations between ADHD scores and values for the two variability measures SD (0.315, p = 0.004) and RMSSD (0.284, p = 0.009), and significant negative correlations between ADHD scores and the two complexity measures sample entropy (−0.316, p = 0.004) and symbolic dynamics (−0.316, p = 0.004). We have not applied any post-hoc corrections to these analyses.

Table 4 Correlations with sum scores on the ADHD adult module of MINI+
Full size table

CPT-II performance in relation to CT, MDQ and bipolar disorder

Among the ADHD patients 59 % had a positive score on the test for cyclothymic temperament. In Table 5 are shown CPT-II data from these patients, separated into two groups based on scores on this test. For reaction time, omission and commission errors, variability and ADHD Confidence index there were no significant differences between the two groups. However, the ADHD group with cyclothymic temperament had higher values for SD (37.2 ± 12.1 vs. 26.8 ± 7.5, p = 0.004, d = 0.98) and RMSSD (45.6 ± 17.7 vs. 31.3 ± 9.4, p = 0.005, d = 0.95) and also lower values for sample entropy (1.48 ± 0.25 vs. 1.68 ± 0.20, p = 0.011, d = −0.86), while skewness was higher (3.45 ± 2.93 vs. 1.86 ± 1.29, p = 0.032, d = 0.65). For the clinical controls those with cyclothymic temperament had similar scores on the CPT-II test as those without this temperament (data not shown). For these four measures we also tested the difference between all four groups using ANOVA. This showed significant results for all measures except symbolic dynamics: F (80,3) = 12,232, p < 0.001 for SD; F (80,3) = 10,560, p < 0.001 for RMSSD; F (80,3) = 10,977, p < 0.001 for sample entropy and F (80,3) = 3,059, p < 0.033 for skewness. Post hoc Bonferroni tests showed that the ADHD + CT group was significantly different from all the three other groups for SD (P = 0.003, <0.001 and <0.001), RMSSD (P = 0.004, <0.001 and <0.001), and sample entropy (P = 0.027, <0.001 and <0.001). For skewness the ADHD + CT group was not significantly different from the ADHD and no CT group.

Table 5 ADHD patients with and without cyclothymic temperament
Full size table

When the ADHD patients are separated into two groups based on the presence or not of positive score on the MDQ questionnaire there were no significant differences (data not shown). Similarly, for ADHD patients with a comorbid bipolar diagnosis, there were no significant differences (data not shown).

Discussion

The main findings of the present study are first that adult patients with ADHD differ from clinical controls on the CPT-II test not only in increased variability, but also reduced complexity. Secondly these changes in variability and complexity are only found in the subgroup of ADHD patients that fulfill criteria for a CT.

For the whole group of patients, omission and commission errors, variability and skewness, discriminate well between patients with ADHD and those with other psychiatric diagnoses, mainly mood and anxiety disorders. The results are similar to previous studies using Conner’s CPT in adult patients. Epstein et al. [34] found more omission and commission errors in ADHD patients than in normal adults, but no difference in reaction time and variability. Similar findings concerning omission and commission errors were reported by Murphy, Barkley and Bush [35], but in addition they found higher RT variability. This was also the conclusion in a meta-analysis by Hervey, Epstein and Curry [10]. The response time distribution of ADHD patients is characterized by some very long response times and consequently high skewness, shown in studies both on children and adolescents [36–38]. This was also found in the present study, and higher skewness separated the patients with ADHD from those without this diagnosis.

We think these data support the notion that the CPT-II is a useful test in the assessment of patients with mixed complaints, including mood, anxiety and attentional problems, in an adult outpatient setting. This is in contrast to previous studies that have found little support for the usefulness of the Conner’s CPT in evaluating adult psychiatric out-patients. Walker et al. [12] found that adults with ADHD performed more poorly than normal adults, but that the test did not discriminate ADHD-patients from patients with mood and anxiety disorders. Similarly, Solanto, Etefi and Marks [13] found that the CPT-test was of little value in the differential diagnosis of adult ADHD vs. mood and anxiety disorders. Both these studies used control groups of psychiatric patients with a range of comorbid disorders, similar to what we had in our clinical control group. However, in the study of Walker et al. [12] the patients in the clinical control group were older and had higher depression scores compared to the ADHD patients, and in the study of Solanto, Etefi and Marks [13] the clinical controls were also older and a larger number had depressive disorders than in the ADHD groups. We think that these factors may have contributed to the lack of ability of the CPT to discriminate ADHD from other psychiatric disorders. Neuropsychological assessment is today not a part of the diagnostic process in adult ADHD. However, we think there is a need for more objective tests, such as CPT, in adult psychiatry, but these contrasting findings clearly show that further studies must be performed to establish the role of this test.

Assignment of an ADHD diagnosis has been based on the fulfillment of formal diagnostic criteria. Even though CPT-II has only been used as supplementary information in the diagnostic process we have used correlation between MINI+ scores and CPT-II measures to get an independent verification of the association between CPT-II and ADHD. These correlations showed the same pattern as we found when CPT-II measures were listed according to the presence or not of a final ADHD diagnosis.

In a number of studies it has been shown that increased intraindividual variability of reaction times is a characteristic feature of ADHD [1, 39, 40]. Variability, measured with the SD, is also an important parameter in a wide range of other conditions and disorders [41, 42]. Increased intraindividual variability has been found in behavioural studies with spontaneously hypertensive rats, an animal model of ADHD [43]. In agreement with this, in the present study we found an increased variability in patients with ADHD, both when assessed with variability of the standard error and with SD calculated for the whole time series. RMSSD has been less well studied as a measure of variability, but gave very similar results compared to the SD, indicating that the short term variability, from one response to the next is not substantially different from the overall variability. We have however not tried to look at variability in different frequency spectra.

Although variability has been offered much attention in the field of ADHD research, complexity has not been given a similar focus. Analysis of the complexity of the present time series show that sample entropy and symbolic dynamics gave very similar results, indicating that in adult ADHD patients there is reduced complexity of response time series, meaning increased order and predictability. This is in agreement with the suggestion that reduced complexity is associated with disease states and aging [17]. In a rat model of depression Friedman et al. [44] found reduced complexity of the firing pattern of dopaminergic neurons. On the other hand the degree of complexity may depend on the dynamics of the system that is being studied. Vaillancourt and Newell [45] suggested that systems characterized by intrinsic oscillations may show increased complexity, and this has for instance been found in a study of the motor activity of schizophrenic patients [15]. The patients we have studied all had psychiatric disorders, but problems with attention are clearly more characteristic of the ADHD patients, and we think it is meaningful that changes in variability and complexity are seen in just these patients. The present findings indicate that the study of RT variability in ADHD would benefit from including methods derived from the study of non-linear systems. This could contribute to the a better understanding of attentional fluctuations and possibly also fluctuations in mood and behaviour [46].

In neuropsychological tests, increased variability has been reported in patients with depression [42], and in studies using mood ratings over long time periods both increased variability [47] and reduced complexity [48] have been reported in patients with mood disorders. Similarly, altered variability and complexity have been found in actigraph recordings from patients with depression and bipolar disorder [19]. There is a close connection between mood disorders and ADHD, and mood symptoms in ADHD usually show a pattern with rapid and short fluctuations [5, 6]. This is reflected in the questions used in the CT questionnaire. The CT is part of the more comprehensive Temperament Evaluation of Memphis, Pisa, Paris and San Diego, auto questionnaire version (TEMPS-A), with subscales also of dysthymic, hyperthymic, irritable and anxious temperaments [8, 9]. The questions are chosen to cover behaviour and experiences reflecting traits that are characteristic of the person over time, and not only episodic manifestations as seen in depressive and manic episodes. There is substantial evidence that these affective temperaments are related to broadly defined bipolar spectrum disorders [49].

Landaas et al. [6] studied the same CT questionnaire in a sample of adult ADHD patients and found that 71 % of these patients had a cyclothymic temperament. We have extended these findings to a mixed out-patient clinical population, and find a comparable figure, 59 % prevalence of CT in adult ADHD patients. When analyzing the raw data from the CPT-II test the ADHD patients with a CT were different from those without this temperament on the two variability measures, skewness and sample entropy, even though the traditional CPT-II measures did not differentiate them. We did not find such a relationship when looking at the subgroups with comorbid bipolar disorder or positive scores on the MDQ questionnaire. This may indicate that even though episodic bipolar disorder, assessed by the MINI + or positive MDQ scores, are frequent in ADHD patients, the affective instability defined by the CT scale may reflect a more basic similarity between bipolar spectrum disorders and a large group of adult ADHD patients. The findings also attest to the usefulness of extracting raw data and performing separate analyzes on these data sets.

The present results are in apparent direct contrast with the findings of Hopwood and Morey [50], that emotional problems may suppress the relationship between continuous performance test results and ADHD symptoms. However, the designs of the studies are so different that a direct comparison is not possible.

Lundervold et al. [51] in a study on adult ADHD patients using the Attention Network Test, found that patients with affective fluctuations, defined by positive scores on the MDQ questionnaire, were more alert, but slower and more easily distracted than those without such fluctuations. Such results also attest to the importance of subdividing adult ADHD patients into subgroups based on affective symptoms.

The only difference we found between the inattentive and combined ADHD subgroups was in reaction time, while none of the other measures differed between groups. In adults Tucha et al. [52] found only small differences between ADHD subgroups using a computerized test battery measuring different aspects of attention, while Solanto et al. [13] found that the inattentive subgroup generally performed worse on the CPT-test compared to the combined subtype. We suggest that the presence of affective instability can be a more useful factor, especially in adults, to subgroup ADHD patients. This is in agreement with studies that also have separated ADHD patients according to temperament [3].

Strengths and limitations

The patients reported on in this study may not be representative of ADHD patients in a general population. Most of them have comorbid psychiatric disorders in addition to ADHD and it is therefore difficult to know the effect of ADHD compared to the contribution from these other conditions. On the other hand, when these patients are seen in an adult psychiatric setting, comorbidity with other disorders is the rule, and also in epidemiological studies the comorbidity is high [2]. It is therefore reasonable to regard the study group as representative of adult ADHD patients coming for evaluation in a psychiatric out-patient clinic. The ADHD patients have been compared to a control group with other psychiatric disorders, but it would of course have been desirable to make comparisons also with a normal control group, matched for age and gender.

The clinical interviews were performed by two different psychiatrists, but the use of the same diagnostic instruments and a final common evaluation of each case by these two, in addition to two other experienced psychiatrists, make it likely that the diagnostic assessment is reasonably accurate.

The time interval between the presented letters (ISI) varies randomly in the CPT, and each individual therefore received a different presentation of intervals. Randomization of intervals between stimulus events has been shown to reduce variability compared to fixed intervals in a go/no-go test [53]. It is therefore conceivable that presentation rate may have influenced the non-linear measurements we have made, in particular symbolic dynamics. This should be taken into consideration when designing further studies using these methods.

We do not think medication is a likely confounding factor. Most of the patients were not using any medication, and among those that did use psychopharmacological agents, antidepressants were the most common medications, and with equal frequency in the ADHD and clinical control groups.

Conclusion

In contrast to some previous studies, we have found that the CPT-II is a useful supplement in the diagnosis of ADHD in adult patients with a mixture of mood, anxiety and attentional problems. Furthermore, it is possible to gain additional information from this test by extracting raw data and performing separate analyzes using linear and non-linear methods. With such an approach we have found that patients with ADHD differ from clinical controls not only in showing increased variability, but also reduced complexity, and that these changes are restricted to the subgroup of ADHD patients that fulfil criteria for a cyclothymic temperament. We suggest that this may be employed not only in subtyping of ADHD patients, but also when trying to predict treatment effects.

Abbreviations

ADHD, attention deficit hyperactivity disorder; ANCOVA, Analysis of covariance; ANOVA, Analysis of variance; ASRS, Adult ADHD Self-Report Scale; CPT, Conner’s Continuous Performance Test; CPT-II, Conner’s Continuous Performance Test II; CT, cyclothymic temperament; DSM-IV, Diagnostic and Statistical Manual of Mental Disorders, 4th Edition; HADS, Hospital Anxiety and Depression Scale; ICD-10, International Classification of mental and behavioural Disorders -10; ISI, inter stimulus interval; MADRS, Montgomery-Asberg Depression Rating Scale; MDQ, Mood Disorder Questionnaire; MINI +, Mini-International Neuropsychiatric Interview; RMSSD, root mean square successive differences; RT, reaction time; SD, standard deviation; SPSS, Statistical Package for the Social Sciences; TEMPS-A, Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego autoquestionnaire; WURS-25, Wender Utah Rating Scale, 25 questions version.

References

  1. Castellanos FX, Kelly C, Milham MP. The restless brain: attention-deficit hyperactivity disorder, resting-state functional connectivity, and intrasubject variability. Can J Psychiatry. 2009;54:665–72.

    PubMed  PubMed Central  Google Scholar 

  2. Haavik J, Halmoy A, Lundervold AJ, Fasmer OB. Clinical assessment and diagnosis of adults with attention-deficit/hyperactivity disorder. Expert Rev Neurother. 2010;10:1569–80.

    Article  PubMed  Google Scholar 

  3. Karalunas SL, Fair D, Musser ED, Aykes K, Iyer SP, Nigg JT. Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria. JAMA psychiatry. 2014;71:1015–24.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Skirrow C, McLoughlin G, Kuntsi J, Asherson P. Behavioral, neurocognitive and treatment overlap between attention-deficit/hyperactivity disorder and mood instability. Expert Rev Neurother. 2009;9:489–503.

    Article  PubMed  Google Scholar 

  5. Halmoy A, Halleland H, Dramsdahl M, Bergsholm P, Fasmer OB, Haavik J. Bipolar symptoms in adult attention-deficit/hyperactivity disorder: a cross-sectional study of 510 clinically diagnosed patients and 417 population-based controls. J Clin Psychiatry. 2010;71:48–57.

    Article  PubMed  Google Scholar 

  6. Landaas ET, Halmoy A, Oedegaard KJ, Fasmer OB, Haavik J. The impact of cyclothymic temperament in adult ADHD. J Affect Disord. 2012;142:241–7.

    Article  CAS  PubMed  Google Scholar 

  7. Chiaroni P, Hantouche E-G, Gouvernet J, Azorin J-M, Akiskal HS. The cyclothymic temperament in healthy controls and familially at risk individuals for mood disorder: endophenotype for genetic studies? J Affect Disord. 2005;85:135–45.

    Article  PubMed  Google Scholar 

  8. Akiskal HS, Akiskal K, Allilaire JF, Azorin JM, Bourgeois ML, Sechter D, Fraud JP, Chatenet-Duchene L, Lancrenon S, Perugi G, Hantouche EG. Validating affective temperaments in their subaffective and socially positive attributes: psychometric, clinical and familial data from a French national study. J Affect Disord. 2005;85:29–36.

    Article  PubMed  Google Scholar 

  9. Akiskal HS, Akiskal KK, Haykal RF, Manning JS, Connor PD. TEMPS-A: progress towards validation of a self-rated clinical version of the Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego Autoquestionnaire. J Affect Disord. 2005;85:3–16.

    Article  PubMed  Google Scholar 

  10. Hervey AS, Epstein JN, Curry JF. Neuropsychology of adults with attention-deficit/hyperactivity disorder: a meta-analytic review. Neuropsychology. 2004;18:485–503.

    Article  PubMed  Google Scholar 

  11. Mcgee RA, Clark SE, Symons DK. Does the Conners’ Continuous Performance Test aid in ADHD diagnosis? J Abnorm Child Psychol. 2000;28:415–24.

    Article  CAS  PubMed  Google Scholar 

  12. Walker AJ, Shores EA, Trollor JN, Lee T, Sachdev PS. Neuropsychological functioning of adults with attention deficit hyperactivity disorder. J Clin Exp Neuropsychol. 2000;22:115–24.

    Article  CAS  PubMed  Google Scholar 

  13. Solanto MV, Etefia K, Marks DJ. The utility of self-report measures and the continuous performance test in the diagnosis of ADHD in adults. CNS Spectr. 2004;9:649–59.

    Article  PubMed  Google Scholar 

  14. Karalunas SL, Huang-Pollock CL, Nigg JT. Decomposing attention-deficit/hyperactivity disorder (ADHD)-related effects in response speed and variability. Neuropsychology. 2012;26:684–94.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Hauge ER, Berle JO, Oedegaard KJ, Holsten F, Fasmer OB. Nonlinear analysis of motor activity shows differences between schizophrenia and depression: a study using Fourier analysis and sample entropy. PLoS One. 2011;6:e16291.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Tang L, Lv H, Yang F, Yu L. Complexity testing techniques for time series data: A comprehensive literature review. Chaos, Solitons Fractals. 2015;81:117–35.

    Article  Google Scholar 

  17. Goldberger AL. Fractal variability versus pathologic periodicity: complexity loss and stereotypy in disease. Perspect Biol Med. 1997;40:543–61.

    Article  CAS  PubMed  Google Scholar 

  18. Zhuang JJ, Ning XB, Du SD, Wang ZZ, Huo CY, Yang X, Fan A. Nonlinear short-term heart rate variability prediction of spontaneous ventricular tachyarrhythmia. Chinese Sci Bull. 2008;53:2446–53.

    Google Scholar 

  19. Krane-Gartiser K, Henriksen TE, Morken G, Vaaler A, Fasmer OB. Actigraphic assessment of motor activity in acutely admitted inpatients with bipolar disorder. PLoS One. 2014;9:e89574.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Conners CK. Conners’ Continuous Performance Test-II (CPT-II) computer program for windows technical guide and software manual. Toronto: Multi-Health Systems Inc.; 2000.

    Google Scholar 

  21. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 2:22–33. quiz 34–57.

    PubMed  Google Scholar 

  22. Leiknes Malt U, Malt EA, Leganger S. KA: mini internasjonalt neuropsykiatrisk intervju plus. Norsk versjon 5.0.0. [The mini-international neuropsychiatric interview plus. Norwegian version]. Oslo: Psykosomatisk avdeling, Rikshospitalet; 2005.

    Google Scholar 

  23. Halmoy A, Fasmer OB, Gillberg C, Haavik J. Occupational outcome in adult ADHD: impact of symptom profile, comorbid psychiatric problems, and treatment: a cross-sectional study of 414 clinically diagnosed adult ADHD patients. J Atten Disord. 2009;13:175–87.

    Article  PubMed  Google Scholar 

  24. Kessler RC, Adler L, Ames M, Demler O, Faraone S, Hiripi E, Howes MJ, Jin R, Secnik K, Spencer T, Ustun TB, Walters EE. The World Health Organization Adult ADHD Self-Report Scale (ASRS): a short screening scale for use in the general population. Psychol Med. 2005;35:245–56.

    Article  PubMed  Google Scholar 

  25. Kessler RC, Adler L, Barkley R, Biederman J, Conners CK, Demler O, Faraone SV, Greenhill LL, Howes MJ, Secnik K, Spencer T, Ustun TB, Walters EE, Zaslavsky AM. The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. Am J Psychiatry. 2006;163:716–23.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Oedegaard KJ, Neckelmann D, Mykletun A, Dahl AA, Zwart JA, Hagen K, Fasmer OB. Migraine with and without aura: association with depression and anxiety disorder in a population-based study. The HUNT Study. Cephalalgia. 2006;26:1–6.

    Article  CAS  PubMed  Google Scholar 

  27. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979;134:382–9.

    Article  CAS  PubMed  Google Scholar 

  28. Hirschfeld RM, Williams JB, Spitzer RL, Calabrese JR, Flynn L, Keck Jr PE, Lewis L, McElroy SL, Post RM, Rapport DJ, Russell JM, Sachs GS, Zajecka J. Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire. Am J Psychiatry. 2000;157:1873–5.

    Article  CAS  PubMed  Google Scholar 

  29. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, Mietus JE, Moody GB, Peng CK, Stanley HE. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. 2000;101:E215–20.

    Article  CAS  PubMed  Google Scholar 

  30. Richman JS, Moorman JR. Physiological time-series analysis using approximate entropy and sample entropy. Am J Physiol Hear Circ Physiol. 2000;278:H2039–49.

    CAS  Google Scholar 

  31. Guzzetti S, Borroni E, Garbelli PE, Ceriani E, Della Bella P, Montano N, Cogliati C, Somers VK, Malliani A, Mallani A, Porta A. Symbolic dynamics of heart rate variability: a probe to investigate cardiac autonomic modulation. Circulation. 2005;112:465–70.

    Article  PubMed  Google Scholar 

  32. Porta A, Tobaldini E, Guzzetti S, Furlan R, Montano N, Gnecchi-Ruscone T. Assessment of cardiac autonomic modulation during graded head-up tilt by symbolic analysis of heart rate variability. AJP Hear Circ Physiol. 2007;293:H702–8.

    Article  CAS  Google Scholar 

  33. Mujica-Parodi LR, Yeragani V, Malaspina D. Nonlinear complexity and spectral analyses of heart rate variability in medicated and unmedicated patients with schizophrenia. Neuropsychobiology. 2005;51:10–5.

    Article  CAS  PubMed  Google Scholar 

  34. Epstein JN, Conners CK, Sitarenios G, Erhardt D. Continuous performance test results of adults with attention deficit hyperactivity disorder. Clin Neuropsychol. 1998;12:155–68.

    Article  Google Scholar 

  35. Murphy KR, Barkley RA, Bush T. Executive functioning and olfactory identification in young adults with attention deficit-hyperactivity disorder. Neuropsychology. 2001;15:211–20.

    Article  CAS  PubMed  Google Scholar 

  36. Leth-Steensen C, King Elbaz Z, Douglas VI. Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach. Acta Psychol (Amst). 2000;104:167–90.

    Article  CAS  Google Scholar 

  37. Hervey AS, Epstein JN, Curry JF, Tonev S, Eugene Arnold L, Keith Conners C, Hinshaw SP, Swanson JM, Hechtman L. Reaction time distribution analysis of neuropsychological performance in an ADHD sample. Child Neuropsychol. 2006;12:125–40.

    Article  PubMed  Google Scholar 

  38. Gu S-LH, Gau SS-F, Tzang S-W, Hsu W-Y. The ex-Gaussian distribution of reaction times in adolescents with attention-deficit/hyperactivity disorder. Res Dev Disabil. 2013;34:3709–19.

    Article  PubMed  Google Scholar 

  39. Johnson KA, Kelly SP, Bellgrove MA, Barry E, Cox M, Gill M, Robertson IH. Response variability in attention deficit hyperactivity disorder: evidence for neuropsychological heterogeneity. Neuropsychologia. 2007;45:630–8.

    Article  PubMed  Google Scholar 

  40. Kofler MJ, Rapport MD, Sarver DE, Raiker JS, Orban SA, Friedman LM, Kolomeyer EG. Reaction time variability in ADHD: a meta-analytic review of 319 studies. Clin Psychol Rev. 2013;33:795–811.

    Article  PubMed  Google Scholar 

  41. MacDonald SW, Nyberg L, Backman L. Intra-individual variability in behavior: links to brain structure, neurotransmission and neuronal activity. Trends Neurosci. 2006;29:474–80.

    Article  CAS  PubMed  Google Scholar 

  42. Kaiser S, Roth A, Rentrop M, Friederich HC, Bender S, Weisbrod M. Intra-individual reaction time variability in schizophrenia, depression and borderline personality disorder. Brain Cogn. 2008;66:73–82.

    Article  PubMed  Google Scholar 

  43. Perry GML, Sagvolden T, Faraone SV. Intraindividual variability (IIV) in an animal model of ADHD - the Spontaneously Hypertensive Rat. Behav Brain Funct. 2010;6:56.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Friedman A, Yadid G, Deri I, Dremencov E, Friedman Y, Goutkin S, Kravchinsky E, Mintz M, Levi D, Overstreet DH. Decoding of dopaminergic mesolimbic activity and depressive behavior. J Mol Neurosci. 2007;32:72–9.

    Article  CAS  PubMed  Google Scholar 

  45. Vaillancourt DE, Newell KM. Changing complexity in human behavior and physiology through aging and disease. Neurobiol Aging. 2002;23:1–11.

    Article  PubMed  Google Scholar 

  46. Esterman M, Noonan SK, Rosenberg M, Degutis J. In the zone or zoning out? Tracking behavioral and neural fluctuations during sustained attention. Cereb Cortex. 2013;23:2712–23.

    Article  PubMed  Google Scholar 

  47. Woyshville MJ, Lackamp JM, Eisengart JA, Gilliland JA. On the meaning and measurement of affective instability: clues from chaos theory. Biol Psychiatry. 1999;45:261–9.

    Article  CAS  PubMed  Google Scholar 

  48. Gottschalk A, Bauer MS, Whybrow PC. Evidence of chaotic mood variation in bipolar disorder. Arch Gen Psychiatry. 1995;52:947–59.

    Article  CAS  PubMed  Google Scholar 

  49. DeGeorge DP, Walsh MA, Barrantes-Vidal N, Kwapil TR. A three-year longitudinal study of affective temperaments and risk for psychopathology. J Affect Disord. 2014;164:94–100.

    Article  PubMed  Google Scholar 

  50. Hopwood CJ, Morey LC. Emotional problems suppress disorder/performance associations in adult ADHD assessment. J Psychopathol Behav Assess. 2008;30:204–10.

    Article  Google Scholar 

  51. Lundervold AJ, Adolfsdottir S, Halleland H, Halmøy A, Plessen K, Haavik J. Attention Network Test in adults with ADHD - the impact of affective fluctuations. Behav Brain Funct. 2011;7:27.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Tucha L, Tucha O, Laufkötter R, Walitza S, Klein HE, Lange KW. Neuropsychological assessment of attention in adults with different subtypes of attention-deficit/hyperactivity disorder. J Neural Transm. 2008;115:269–78.

    Article  CAS  PubMed  Google Scholar 

  53. Lee RWY, Jacobson LA, Pritchard AE, Ryan MS, Yu Q, Denckla MB, Mostofsky S, Mahone EM. Jitter reduces response-time variability in ADHD: an Ex-gaussian analysis. J Atten Disord. 2015;19:794–804.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We will like to thank Petter Jakobsen for help with recovery of data from a damaged PC and Erlend Fasmer for making the program for the symbolic dynamic analyses available to us.

Funding

The author disclosed receipt of the following financial support for the research related to this article: The Western Norway Regional Health Authority.

Availability of data and materials

Raw data might be available upon request by contacting the corresponding author; however, the request must comply with confidentiality and ethics rules of the Ethics Committee of our Institution.

Authors’ contributions

KM, WF, JOB, OBF and ALH designed this study. KM and WF provided patients and collected data. The mathematical and statistical analyses were performed by OBF. All authors (OBF, KM, WF, AH, VEGS, KJO and JOB), participated in interpreting the results and drafting the manuscript. All authors (OBF, KM, WF, AH, VEGS, KJO and JOB) read and approved the final version of the manuscript.

Authors’ information

Not applicable.

Competing interests

The authors declare that they have no competing interest.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The study protocol was approved by the Norwegian Regional Medical Research Ethics Committee West (251.08). Written informed consent was obtained from all participants involved in the study.

Author information

Authors and Affiliations

  1. Division of Psychiatry, Haukeland University Hospital, Bergen, Norway

    Ole Bernt Fasmer, Vigdis Elin Giæver Syrstad, Ketil J. Oedegaard & Jan Øystein Berle

  2. Department of Clinical Medicine, Section for Psychiatry, University of Bergen, Bergen, Norway

    Ole Bernt Fasmer & Ketil J. Oedegaard

  3. K.G. Jebsen Centre for Research on Neuropsychiatric Disorders, Bergen, Norway

    Ole Bernt Fasmer & Ketil J. Oedegaard

  4. Madlamarkveien 2a, Hafrsfjord, Norway

    Kristin Mjeldheim

  5. Lagårdsveien 91, Stavanger, Norway

    Wenche Førland

  6. Department of Clinical Psychology, University of Bergen, Bergen, Norway

    Anita L. Hansen

  7. Centre for Research and Education in Forensic Psychiatry, Haukeland University Hospital, Bergen, Norway

    Anita L. Hansen

  8. Department of Neuroscience, the Norwegian University of Science and Technology, Trondheim, Norway

    Vigdis Elin Giæver Syrstad

  9. Department of Clinical Medicine, Section for Psychiatry, University of Bergen, Haukeland University Hospital, N-5021, Bergen, Norway

    Ole Bernt Fasmer

Authors
  1. Ole Bernt Fasmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kristin Mjeldheim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenche Førland
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anita L. Hansen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vigdis Elin Giæver Syrstad
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ketil J. Oedegaard
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jan Øystein Berle
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ole Bernt Fasmer.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fasmer, O.B., Mjeldheim, K., Førland, W. et al. Linear and non-linear analyses of Conner’s Continuous Performance Test-II discriminate adult patients with attention deficit hyperactivity disorder from patients with mood and anxiety disorders. BMC Psychiatry 16, 284 (2016). https://doi.org/10.1186/s12888-016-0993-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-016-0993-4

Keywords

BMC Psychiatry

ISSN: 1471-244X

Contact us