Skip to main content
  • Research article
  • Open access
  • Published:

Hyperactivity/restlessness is associated with increased functional connectivity in adults with ADHD: a dimensional analysis of resting state fMRI

Abstract

Background

Adult attention-deficit/hyperactivity disorder (ADHD) is a serious and frequent psychiatric disorder of multifactorial pathogenesis. Several lines of evidence support the idea that ADHD is, in its core, a disorder of dysfunctional brain connectivity within and between several neurofunctional networks. The primary aim of this study was to investigate associations between the functional connectivity within resting state brain networks and the individual severity of core ADHD symptoms (inattention, hyperactivity, and impulsivity).

Methods

Resting state functional magnetic resonance imaging (rs-fMRI) data of 38 methylphenidate-naïve adults with childhood-onset ADHD (20 women, mean age 40.5 years) were analyzed using independent component analysis (FSL’s MELODIC) and FSL’s dual regression technique. For motion correction, standard volume-realignment followed by independent component analysis-based automatic removal of motion artifacts (FSL’s ICA-AROMA) were employed. To identify well-established brain networks, the independent components found in the ADHD group were correlated with brain networks previously found in healthy participants (Smith et al. PNAS 2009;106:13040–5). To investigate associations between functional connectivity and individual symptom severity, sex, and age, linear regressions were performed.

Results

Decomposition of resting state brain activity of adults with ADHD resulted in similar resting state networks as previously described for healthy adults. No significant differences in functional connectivity were seen between women and men. Advanced age was associated with decreased functional connectivity in parts of the bilateral cingulate and paracingulate cortex within the executive control network. More severe hyperactivity was associated with increased functional connectivity in the left putamen, right caudate nucleus, right central operculum and a portion of the right postcentral gyrus within the auditory/sensorimotor network.

Conclusions

The present study supports and extends our knowledge on the involvement of the striatum in the pathophysiology of ADHD, in particular, in the pathogenesis of hyperactivity. Our results emphasize the usefulness of dimensional analyses in the study of ADHD, a highly heterogeneous disorder.

Trial registration

ISRCTN12722296 (https://doi.org/10.1186/ISRCTN12722296).

Peer Review reports

Background

Attention-deficit/hyperactivity disorder (ADHD) is a common and impairing psychiatric disorder characterized by varying degrees of inattention, hyperactivity, and impulsivity. ADHD is not limited to children and adolescents. In 40–60% of children with ADHD, the disorder persists into adulthood [1]. In adults with ADHD, inattention may present as a lack of concentration, forgetting appointments, and a failure to plan and organize tasks, while hyperactivity may be experienced as restlessness and difficulty in relaxing [1, 2]. ADHD symptoms frequently lead to problems at school and at the workplace as well as to difficulties with social interaction and relationships [2].

The pathogenesis of ADHD is incompletely understood. Clinical, genetic and experimental evidence suggests that ADHD is a multifactorial disorder, associated with neurochemical [3], anatomical [4,5,6] and functional [7, 8] changes of neuronal networks. The notion that ADHD is, in its core, a disorder of dysfunctional brain connectivity within and between several neurofunctional networks has gained wide acceptance [8, 9].

One way to investigate the circuitry of the brain is to perform resting state functional magnetic resonance imaging (rs-fMRI). In contrast to task-based fMRI, rs-fMRI measurements record the spontaneous fluctuations of brain activity during wakeful rest, i.e. in the absence of an experimental task or stimulation. Using rs-fMRI, several distinct resting state networks (RSNs) have been identified in health and disease [10].

Both in children and adults with ADHD, a dysfunction of the default mode network (DMN) has been postulated. The DMN is a set of brain regions, including the posterior cingulate cortex, precuneus, and medial prefrontal cortex, which are active during rest and become deactivated with the initiation of a task [11, 12]. A pioneering rs-fMRI study on 20 ADHD adults (mean age: 34.9 years; 16 men) and 20 healthy participants (mean age: 31.2 years; 14 men) found decreased functional connectivity within the DMN and between posterior regions of the DMN (i.e., the precuneus and posterior cingulate) and the dorsal anterior cingulate [13].

Since then, a large number of studies on rs-fMRI in individuals with ADHD have been published [8]. Most of these studies have investigated children and adolescents and performed categorical analyses, comparing functional connectivity between individuals with ADHD and healthy controls. Several research groups have used the freely available ADHD-200 sample, consisting of rs-fMRI data of 285 children and adolescents with ADHD and 491 healthy age-matched controls [14]Footnote 1 to address differences in functional connectivity in categorical and dimensional analyses [15,16,17].

Our primary interest lies in adults with ADHD [18, 19]. For this population, only a relatively small number of studies on resting state functional connectivity is available. These studies confirmed and extended our pathophysiological knowledge of adult ADHD. However, most studies investigated adults who have received methylphenidate (for notable exceptions, see [20]). In addition, most studies on adult ADHD performed categorical comparisons between individuals with ADHD and controls. As ADHD is a disorder of remarkable clinical heterogeneity, we decided to investigate functional connectivity within resting state networks in relation to ADHD symptom severity in a group of methylphenidate-naïve adults with childhood-onset ADHD following a dimensional approach to investigate psychiatric disorders [21].

To study functional connectivity within neural networks, we performed a group independent component analysis (ICA) with dual regression. The group ICA identifies a set of independent component maps that are common to our entire sample. Dual regression is a mathematical approach that uses these independent component maps as network templates to identify the corresponding functional connectivity maps, indicating the strength of functional connectivity in each subject (for a detailed explanation, see [22]).

Aim and hypotheses

The aims of the present study are twofold. First, we will characterize well-established resting state networks, previously described in healthy individuals, in our sample of adults with ADHD. Second, we will investigate potential associations between the functional connectivity in these networks and the individual severity of core ADHD symptoms (inattention, hyperactivity, and impulsivity). We hypothesized that functional connectivity within the default mode network will be smaller in individuals with ADHD with increased symptom severity.

Methods

Participants

This study is part of a larger project on structural and functional changes of the brain in adults with ADHD. Structural MRIs from this project were analyzed using surface-based morphometry [23]. Results of task-related fMRI measurements were reported by Bachmann et al. [24].

Resting state fMRI data sets from 59 adults with ADHD were analyzed for this study. Data sets were taken from a randomized controlled trial that compared the efficacy of a mindfulness training program (mindfulness awareness practice) to an active control condition (structured psychoeducation) in adult ADHD [25]. A control group of healthy individuals was therefore not studied. All datasets analyzed here were recorded at baseline, i.e. before the mindfulness training program or psychoeducation started.

After head motion correction using FSL’s MCFLIRT [26], 21 individuals were excluded because the maximum absolute displacement was > 1.5 mm (half of the isotropic voxel size). The absolute displacement, as determined by MCFLIRT, summarizes translation and rotation across all three axes for every volume relative to the middle volume of the rs-fMRI data set [27]. This criterion was chosen according to the rs-fMRI study by Mostert et al., investigating adults with ADHD using FSL’s dual regression approach [28]. Thus, the data sets of 38 individuals with ADHD (20 women) were included in the final analysis. Demographics and clinical characteristics of this sample are summarized in Table 1. The distribution of participants’ age is illustrated in Fig. 1a.

Table 1 Demographics and clinical characteristics of all adults with ADHD included in the final data analysis
Fig. 1
figure 1

1a. The distribution of age in the analyzed sample of 38 adults with ADHD. 1b. The distribution of the scores on the CAARS inattention/memory problems, hyperactivity/restlessness, and impulsivity/emotional lability subscales. The red diamond represents the mean, the error bars the standard deviation in both parts of the figure

The clinical trial is registered in the ISRCTN registryFootnote 2 (ISRCTN12722296)Footnote 3 and has been approved by the Ethics Committee of the Faculty of Medicine, University of Freiburg, Germany. All participants provided written informed consent.

Recruitment of participants has been described previously [23, 24]. In brief, participants were recruited at the Department of Psychiatry and Psychotherapy, Medical Center - University of Freiburg, Germany and through ADHD support groups. Inclusion and exclusion criteria have also been described previously [23, 24]. In brief, we included individuals between 18 and 65 years with childhood-onset ADHD, who never used methylphenidate.

Diagnosis and clinical data

The diagnosis of ADHD was performed by experienced psychiatrists following DSM-IV criteria as described previously [23,24,25]. ADHD symptom severity was measured with the Conners Adult ADHD Rating Scales [29] in the German long version with 66 items [30]. We present the blind observer-rated CAARS scores (CAARS-O:L) on the inattention/memory problems, hyperactivity/restlessness, and impulsivity/emotional lability subscales. The distribution of the individual scores on the 3 subscales is illustrated in Fig. 1b. Psychiatric comorbidities were assessed using the German version of the Structured Clinical Interview for DSM-IV (SKID) [31].

MRI data acquisition

Structural and functional images of the brain were acquired on a 3 Tesla Siemens Magnetom Trio with a 12-channel head coil at the Freiburg Brain Imaging Center as described earlier [23, 24]. In brief, a T1-weighted image was acquired using a three-dimensional MP-RAGE sequence with a voxel size of 1 × 1 × 1 mm3. For the resting state measurement, T2*-weighted BOLD images were obtained with a voxel size of 3 × 3 × 3 mm3 and 36 axial slices with a slice thickness of 3 mm (TR = 2250 ms, TE = 30 ms, no in-plane acceleration, 230 brain volumes, time of acquisition: 8:42 min). The field of view covered the entire cerebrum, but only the most rostral parts of the cerebellum in most participants. All participants were instructed to lie quietly and keep the eyes closed without falling asleep. The resting state measurement was preceded by the T1-weighted image and 2 runs of a 1-back working memory task (time of acquisition: 6:16 min each) and 2 runs of a stop signal task (time of acquisition: 6:09 min each). These task-based fMRI measurements were not included in the present study. The results of the 1-back working memory task have been reported by Bachmann et al. [24].

Preprocessing of fMRI data

Preprocessing of resting state FMRI data was carried out using FMRIB’s Software Library (FSL, version 5.09)Footnote 4 [32,33,34]. Preprocessing included removal of the first 5 volumes to allow for signal equilibration (225 volumes were retained) and head motion correction by volume-realignment to the middle volume using MCFLIRT [26]. Brain extraction was performed using BET [35]. Spatial smoothing with a Gaussian kernel of 6 mm full width at half maximum (FWHM) and grand-mean intensity normalization of the entire dataset by a single multiplicative factor were also done.

After performing standard data preprocessing, without temporal filtering, independent component analysis-based automatic removal of motion artifacts (FSL’s ICA-AROMA version 0.3 beta)Footnote 5 was used to identify and remove motion-related ICA components from fMRI data. Here, the ‚non-aggressive‘ option was used, performing a partial component regression. ICA-AROMA carries out probabilistic ICA of individual subjects’ rs-fMRI data using multivariate exploratory linear decomposition into independent components (FSL’s MELODIC, version 3.14) [36], employs four theoretically motivated temporal and spatial features to select motion-related components from MELODIC’s output and finally removes these components from the initial data set through an ordinary least squares regression using FSL’s fsl_regfilt command [37]. ICA-AROMA is an effective strategy for removing motion-related artifacts from rs-fMRI data, preserving signal of interest and increasing the reproducibility of resting state networks [38, 39]. ICA-AROMA does not require study-specific training (i.e. manual classification of artifact- and non-artifact-related independent components) and is thus a robust and generalizable approach.

The de-noised data sets were then high-pass filtered with a cutoff of 150 s (0.007 Hz). Registration of functional to high resolution structural images was carried out using boundary-based registration [40] in FLIRT [26]. Registration from high resolution structural to Montreal Neurological Institute (MNI152) standard space was further refined using 12-parameter affine transformation and non-linear registration with a warp resolution of 10 mm in FNIRT.Footnote 6

Identification of resting state networks

To identify RSNs common to adults with ADHD, all data sets (n = 38, preprocessed and de-noised with ICA-AROMA as described above) were concatenated in temporal order to create a single data set. This concatenated data set was then decomposed into 20 spatially independent components using group ICA with MELODIC. A low-dimensional decomposition was chosen to facilitate the comparison of RSNs in adult ADHD with those identified in healthy adults [10, 41, 42]. These 20 components will be used as template maps for dual regression (see next section).

To investigate the occurrence of previously described RSNs in adult ADHD, a spatial cross-correlation between these 20 independent components in our sample and the 20 independent components identified previously [10] was calculated using FSL’s fslcc command. MR image files of Smith et al.’s template networks [10] are available for download.Footnote 7 For further analysis and visualization (Fig. 3), 10 canonical RSNs in our data were chosen that showed a high spatial correspondence (> 0.4) with the well-established RSNs published by Smith et al. [10].

Statistical analysis of resting state networks

To investigate the associations between RSNs and clinical data (sex, age, and ADHD symptom severity), FSL’s dual_regression script (version 0.5) was used [22, 43]. In the first stage of dual regression, the full set of 20 template maps (the 20 independent components identified by group ICA) was regressed against each participant’s 4-dimensional rs-fMRI data set, resulting in 20 time series per participant, one for each template map. In the second stage of dual regression, the component-specific time series were variance-normalized and regressed against each participant’s rs-fMRI data set to identify participant-specific spatial maps corresponding to the 20 template maps.

To identify differences between women and men within the 10 canonical networks, a voxel-wise two-sample unpaired t-test with age as regressor of no interest was performed on the participant-specific spatial maps for each network using a general linear model. To identify associations between age and functional connectivity within the 10 canonical networks, age was used as regressor of interest with sex as regressor of no interest in the general linear model. To identify associations between ADHD symptom severity and functional connectivity within the 10 canonical networks, the individual scores on the inattention/memory problems, hyperactivity/restlessness, and impulsivity/emotional lability CAARS subscales were used as separate regressors of interest with sex and age as regressors of no interest. For non-parametric permutation testing, FSL’s randomise (version 2.9) was used with 5000 permutations [44, 45]. Statistical thresholding was performed with FSL’s threshold-free cluster enhancement (TFCE) [46] and a family-wise error rate (FWE) of p smaller than 0.05. As the existing literature does not support specific hypotheses regarding the association between whole-brain networks and symptom severity in adult ADHD, this study needs to be exploratory. We decided not to perform correction for multiple comparisons (e.g. Bonferroni correction). To reduce the risk of false positive activation, we only accepted clusters larger than 100 voxels.

Results

Head motion

Figure 2 shows maximum head motion for every participant, expressed as absolute displacement (relative to the middle volume of the data set) and estimated by FSL’s MCFLIRT. Across all participants, mean maximum head motion was 0.71 mm (SD: 0.32 mm). In the majority of participants, maximum head motion was smaller than 1 mm.

Fig. 2
figure 2

Maximum head motion (absolute displacement) for all 38 adults with ADHD. The figure shows the maximum value of absolute displacement (mm), which summarizes translation and rotation across all three axes for every volume relative to the middle volume of the rs-fMRI data set

Resting state networks in adult ADHD

After low-dimensional decomposition with MELODIC, the following RSNs, described by Smith et al. [10], were also found in our sample: the visual, default mode, sensorimotor, auditory, executive control, and bilateral fronto-parietal networks. The DMN, one RSN in the study by Smith et al. [10], is decomposed into two networks in our analysis, a ventral and a dorsal DMN. The cerebellar RSN, found by Smith et al., did not appear in our study because of the incomplete coverage of the cerebellum during rs-fMRI scanning. Figure 3 illustrates the 10 RSNs identified in our sample of adults with ADHD (components 1–8, 10, 13 of the original 20-component group ICA).

Fig. 3
figure 3

Ten resting state networks (RSNs) identified in a sample of 38 adults with ADHD, corresponding to the 10 RSNs found by Smith et al. [10]. Brain images are displayed in radiological convention (the right hemisphere appears on the left side of the image)

Additional file 1 Appendix 1 summarizes the 10 components that were excluded from further analyses (components 9, 11, 12, 14–20 of the original 20-component group ICA). Of those, component 9 is truncated because of incomplete coverage of the cerebellum. Component 11 shows strong activation of the anterior cingulate, similar to the executive control network included in further analysis (component 6 in Fig. 2). Component 12 shows strong activation in the bilateral inferior frontal and temporal lobes, similar to the auditory and fronto-parietal networks included in further analysis (components 4, 9 and 10 in Fig. 2). The remaining components display primarily artifactual signal changes (i.e., non-neuronal noise).

Differences in functional connectivity between women and men with ADHD

An independent t-test with age as covariate of no interest did not reveal significant differences in functional connectivity between women and men in our sample.

Associations between functional connectivity and age

In ADHD participants with advanced age, a significant decrease of functional connectivity was found in the executive control network (IC 6), covering parts of the bilateral anterior cingulate cortex and the bilateral paracingulate cortex (Fig. 4).

Fig. 4
figure 4

Regions of decreased functional connectivity in older individuals with ADHD within the executive control network (IC 6 in Fig. 2). The significant cluster covers parts of the bilateral anterior cingulate cortex and the bilateral paracingulate cortex (cluster size: 493 voxels). The coordinates of the voxel with highest significance are: x = − 2 mm, y = 42 mm, z = − 2 mm (p = 0.004). Brain images are displayed in radiological convention (the right hemisphere appears on the left side of the image).

Associations between functional connectivity and ADHD symptom severity

In ADHD participants with higher scores on the CAARS hyperactivity/restlessness subscale, increased functional connectivity was found within the auditory/sensorimotor RSN (IC 5). These areas cover parts of the left putamen, right caudate nucleus, right central operculum and a portion of the right postcentral gyrus (Fig. 5, Table 2). Scores on the inattention/memory problems and impulsivity/emotional lability subscales were not associated with changes in functional connectivity.

Fig. 5
figure 5

Regions of increased functional connectivity in adults with ADHD with higher scores on the CAARS hyperactivity/restlessness subscale within the auditory / sensorimotor resting state network. Location, p-values and cluster sizes are summarized in Table 2. Brain images are displayed in radiological convention (the right hemisphere appears on the left side of the image)

Table 2 Regions of increased functional connectivity in adults with ADHD with higher scores on the hyperactivity/restlessness subscale

Discussion

This study on 38 methylphenidate-naïve adults with ADHD has three main findings. First, on the group level, decomposition of resting state brain activity of adults with ADHD resulted in similar RSNs as previously described for healthy adults [10]. Second, advanced age was associated with decreased functional connectivity in parts of the bilateral cingulate and paracingulate cortex within the executive control network. Third, higher scores on the CAARS hyperactivity/restlessness subscale were associated with increased functional connectivity in cortical and subcortical areas within the auditory/sensorimotor network.

Resting state networks in adult ADHD

The RSNs found in our ADHD sample demonstrated a close correspondence to previously published RSNs in healthy adults [10]. The RSNs by Smith et al. [10] were derived from a group of 36 healthy individuals (15 women), similar in size to our sample. Moreover, rs-fMRI measurements by Smith et al. [10] and for our study were performed with identical scanner hardware (a 3 T Siemens Magnetom Trio with a 12-channel head coil).

Decreased functional connectivity with advanced age in adult ADHD

To the best of our knowledge, the association between functional connectivity and age has not been investigated in adults with ADHD before. Here, we found a decrease of functional connectivity in the bilateral cingulate and paracingulate cortices within the executive control network in older ADHD participants (Fig. 4). In a previous study, we analyzed the structural MRIs acquired for this trial (n = 64) to determine cortical thickness and subcortical gray matter volumes using surface-based morphometry and subcortical segmentation as implemented in FreeSurfer [23]. Interestingly, we found wide-spread cortical thinning and subcortical volume reduction associated with aging in adults with ADHD, but no significant decrease of cortical thickness in the bilateral cingulate and paracingulate cortices. These structural findings suggest that the age-related decrease in functional connectivity is a genuine phenomenon of brain function and not an epiphenomenon of gray matter loss.

Changes in functional connectivity as a function of age have been described previously in healthy aging [47, 48]. Thus, the observed decrease of functional connectivity in the bilateral cingulate and paracingulate cortex may be specific to ADHD or may be caused by unspecific aging processes. Of note, we did not find a decrease of functional connectivity in the default mode network in older individuals with ADHD. In healthy aging, a decrease of default mode connectivity is a widely replicated finding [47, 48].

Increased functional connectivity with higher scores on the hyperactivity/restlessness subscale in adult ADHD

We also found increased functional connectivity in parts of the bilateral striatum (in particular, left putamen and right caudate nucleus), right central operculum and right postcentral gyrus in participants with higher scores on the CAARS hyperactivity/restlessness subscale (Fig. 5). The basal ganglia are a set of subcortical nuclei that subserve motor control, various cognitive functions and emotional processing, with the striatum being the primary input nucleus [49]. More recently, evidence has accumulated that the basal ganglia are also involved in behavioral and neural inhibition in motor and non-motor functions [50].

Dysfunction of the basal ganglia and fronto-striatal circuits has long been suggested to be one of the core pathomechanisms of ADHD. This notion has been supported by the dopaminergic effects of methylphenidate, the major pharmacological treatment for ADHD. The reduction of subcortical gray matter in children with ADHD [4,5,6] appears to normalize in adults [6] and is probably not involved in basal ganglia dysfunction in adults with ADHD. In a recent analysis of the structural MRIs of more than 500 adults with ADHD (> 21 years) and more than 400 healthy controls, no significant difference in volume was found for any of the subcortical nuclei under investigation, including the caudate nucleus, putamen and pallidum [6].

Functional MRI of inhibitory control in adult ADHD led to inconsistent results [51]. Sebastian et al. [52] performed fMRI in stimulant-naïve adults with ADHD during three different experimental tasks probing interference inhibition, action withholding and action cancelation. This study disclosed hypoactivation of the basal ganglia during action withholding and action cancelation [52]. By contrast, a quantitative meta-analysis of fMRI studies on inhibitory control in 100 adults with ADHD in total (including individuals receiving long-term stimulant medication) concluded that adults with ADHD have hypoactivation of the right inferior frontal cortex and right thalamus relative to controls, but no hypoactivation of the basal ganglia [53].

A recent study by Mostert et al. [28] compared rs-fMRI in 99 adults with ADHD with 113 healthy individuals and found stronger functional connectivity in the anterior cingulate gyrus of the executive control RSN, but no differences in connectivity in the basal ganglia or the default mode network.

The aforementioned studies performed categorical comparisons between individuals with ADHD and healthy controls. ADHD, however, is characterized by a remarkable phenotypic and genetic heterogeneity [54, 55] and comparisons on the group level may fail to uncover neural dysfunction in heterogeneous ADHD samples. For this reason, we performed dimensional analyses with the individual levels of symptom severity as continuous regressors [56] which enabled us to detect associations between a clinical parameter (hyperactivity/restlessness) and resting state brain activity.

In a large sample of adolescents with ADHD, Oldehinkel et al. [57] performed both categorical and dimensional analyses of functional connectivity in striatal networks. Comparing 169 adolescents with ADHD and 122 healthy individuals did not reveal functional differences in striatal networks. A dimensional analysis, by contrast, demonstrated an association between increased hyperactivity/impulsivity scores and increased inattention scores with increased functional connectivity in the networks of posterior putamen and ventral caudate [57]. Similarly, in children with the hyperactive-impulsive subtype of ADHD, increased connectivity in the cortico-striatal network was found, whereas children with the inattentive subtype showed increased connectivity in the ventral attention network [58]. The results of the present study corroborate the findings of Oldehinkel et al. [57] and Sanefuji et al. [58]. In summary, a dimensional approach may be better suited to identify changes in basal ganglia connectivity [57, 58] than a categorical approach [28].

Contrary to our initial hypothesis, no significant associations between functional connectivity within the ventral and dorsal DMNs and the symptom severity scores were identified in the present study. This result is also in contrast to previous studies in childhood, adolescent and adult ADHD, describing weaker connectivity within the DMN in individuals with ADHD vs. controls [8]. In adult ADHD, decreased functional connectivity was found between the anterior cingulate and the precuneus/posterior cingulate cortex regions in a seed-based analysis [13] and between the precuneus and other areas of the DMN using a network homogeneity analysis [59]. By contrast, the large study on resting state functional connectivity by Mostert et al. consisting of 99 adults with ADHD, using group ICA and dual regression very similar to the present study, did not find differences in DMN connectivity between adults with ADHD and controls. Taken together, the involvement of the DMN in adult ADHD is not well established. Future studies are needed with larger sample sizes, comparing and integrating the results of different analysis strategies.

Strengths and limitations

Our study comprises a clinically-well characterized sample of 38 methylphenidate-naïve adults with ADHD. Many studies in the field include participants with long-term stimulant medication as well (and discontinue medication ~ 24–48 h before fMRI, e.g. [28, 57]. Investigating a stimulant-naïve sample is beneficial because of potential effects of long-term stimulant medication on brain structure and function [60, 61]. Another strength of our study is a stringent two-step head motion correction with a standard motion correction with volume-realignment and an additional ICA-based de-noising of the preprocessed data sets.

Limitations of our study are the absence of a healthy control group, which prevented us from performing categorical comparisons between adults with ADHD and healthy individuals. Moreover, the fMRI scans used for this study did not cover the entire cerebellum, a structure, which has been implicated in the pathogenesis of ADHD [62].

Future studies of resting state brain activity in ADHD should make use of advanced imaging techniques that allow a considerable reduction of the TR (simultaneous multislice imaging) [63].

Conclusions

This study corroborates and extends our knowledge on the involvement of the striatum in the pathophysiology of ADHD, in particular, in the pathogenesis of hyperactivity. Moreover, we found, for the first time, a decrease of functional connectivity in the bilateral cingulate and paracingulate cortices within the executive control network in older individuals with ADHD. Significant associations between functional connectivity in the default mode network and symptom severity, sex or age were not found. Our results emphasize the usefulness of dimensional analyses with individual symptom severity and age as regressors in the study of ADHD, a highly heterogeneous disorder.

Notes

  1. http://fcon_1000.projects.nitrc.org/indi/adhd200/

  2. https://www.isrctn.com

  3. https://doi.org/10.1186/ISRCTN12722296

  4. http://www.fmrib.ox.ac.uk/fsl

  5. https://github.com/rhr-pruim/ICA-AROMA

  6. https://fsl.fmrib.ox.ac.uk/fsl/fslwiki/FNIRT

  7. https://www.fmrib.ox.ac.uk/datasets/brainmap+rsns

Abbreviations

ADHD:

Attention-deficit/hyperactivity disorder

BET:

Brain extraction tool

BOLD:

Blood oxygenation level dependent

CAARS:

Conners adult ADHD rating scales

DMN:

Default mode network

DSM-IV:

Diagnostic and statistical manual of mental disorders, 4th edition

FLIRT:

FMRIB’s linear image registration tool

fMRI:

Functional magnetic resonance imaging

FNIRT:

FMRIB’s non-linear image registration tool

FoV:

Field of view

FSL:

FMRIB’s Software Library

FWE:

Family-wise error

IC:

Independent component

ICA:

Independent component analysis

ICA-AROMA:

Independent component analysis-based automatic removal of motion artifacts

MCFLIRT:

Motion correction FMRIB’s linear image registration tool

MELODIC:

Multivariate exploratory linear decomposition into independent components

MP-RAGE:

Magnetization-prepared rapid acquisition gradient-echo

rs-fMRI:

Resting state functional magnetic resonance imaging

RSN:

Resting state network

TE:

Echo time

TFCE:

Threshold-free cluster enhancement

TI:

Inversion time

TR:

Repetition time

References

  1. Volkow ND, Swanson JM. Clinical practice: adult attention deficit-hyperactivity disorder. N Engl J Med. 2013;369:1935–44.

    Article  CAS  Google Scholar 

  2. Rösler M, Casas M, Konofal E, Buitelaar J. Attention deficit hyperactivity disorder in adults. World J Biol Psychiatry. 2010;11:684–98.

    Article  Google Scholar 

  3. Sharma A, Couture J. A review of the pathophysiology, etiology, and treatment of attention-deficit hyperactivity disorder (ADHD). Ann Pharmacother. 2014;48:209–25.

    Article  Google Scholar 

  4. Nakao T, Radua J, Rubia K, Mataix-Cols D. Gray matter volume abnormalities in ADHD: voxel-based meta-analysis exploring the effects of age and stimulant medication. Am J Psychiatry. 2011;168:1154–63.

    Article  Google Scholar 

  5. Frodl T, Skokauskas N. Meta-analysis of structural MRI studies in children and adults with attention deficit hyperactivity disorder indicates treatment effects. Acta Psychiatr Scand. 2012;125:114–26.

    Article  CAS  Google Scholar 

  6. Hoogman M, Bralten J, Hibar DP, Mennes M, Zwiers MP, Schweren LS, van Hulzen KJ, Medland SE, Shumskaya E, Jahanshad N, Zeeuw P, Szekely E, Sudre G, Wolfers T, Onnink AM, Dammers JT, Mostert JC, Vives-Gilabert Y, Kohls G, Oberwelland E, Seitz J, Schulte-Rüther M, Ambrosino S, Doyle AE, Høvik MF, Dramsdahl M, Tamm L, van Erp TG, Dale A, Schork A, Conzelmann A, Zierhut K, Baur R, McCarthy H, Yoncheva YN, Cubillo A, Chantiluke K, Mehta MA, Paloyelis Y, Hohmann S, Baumeister S, Bramati I, Mattos P, Tovar-Moll F, Douglas P, Banaschewski T, Brandeis D, Kuntsi J, Asherson P, Rubia K, Kelly C, Martino AD, Milham MP, Castellanos FX, Frodl T, Zentis M, Lesch KP, Reif A, Pauli P, Jernigan TL, Haavik J, Plessen KJ, Lundervold AJ, Hugdahl K, Seidman LJ, Biederman J, Rommelse N, Heslenfeld DJ, Hartman CA, Hoekstra PJ, Oosterlaan J, Polier GV, Konrad K, Vilarroya O, Ramos-Quiroga JA, Soliva JC, Durston S, Buitelaar JK, Faraone SV, Shaw P, Thompson PM, Franke B. Subcortical brain volume differences in participants with attention deficit hyperactivity disorder in children and adults: a cross-sectional mega-analysis. Lancet Psychiatry. 2017;4:310–9.

    Article  Google Scholar 

  7. Cortese S, Kelly C, Chabernaud C, Proal E, Di Martino A, Milham MP, Castellanos FX. Toward systems neuroscience of ADHD: a meta-analysis of 55 fMRI studies. Am J Psychiatr. 2012;169:1038–55.

    Article  Google Scholar 

  8. Castellanos FX, Aoki Y. Intrinsic functional connectivity in attention-deficit/hyperactivity disorder: a science in development. Biol Psychiatry Cogn Neurosci Neuroimaging. 2016;1:253–61.

    Article  Google Scholar 

  9. Gallo EF, Posner J. Moving towards causality in attention-deficit hyperactivity disorder: overview of neural and genetic mechanisms. Lancet Psychiatry. 2016;3:555–67.

    Article  Google Scholar 

  10. Smith SM, Fox PT, Miller KL, Glahn DC, Fox PM, Mackay CE, Filippini N, Watkins KE, Toro R, Laird AR, Beckmann CF. Correspondence of the brain's functional architecture during activation and rest. Proc Natl Acad Sci U S A. 2009;106:13040–5.

    Article  CAS  Google Scholar 

  11. Raichle ME, MacLeod AM, Snyder AZ, Powers WJ, Gusnard DA, Shulman GL. A default mode of brain function. Proc Natl Acad Sci U S A. 2001;98:676–82.

    Article  CAS  Google Scholar 

  12. Mohan A, Roberto AJ, Mohan A, Lorenzo A, Jones K, Carney MJ, Liogier-Weyback L, Hwang S, Lapidus KA. The significance of the default mode network (DMN) in neurological and neuropsychiatric disorders: a review. Yale J Biol Med. 2016;89:49–57.

    PubMed  PubMed Central  Google Scholar 

  13. Castellanos FX, Margulies DS, Kelly C, Uddin LQ, Ghaffari M, Kirsch A, Shaw D, Shehzad Z, Di Martino A, Biswal B, Sonuga-Barke EJ, Rotrosen J, Adler LA, Milham MP. Cingulate-precuneus interactions: a new locus of dysfunction in adult attention-deficit/hyperactivity disorder. Biol Psychiatry. 2008;63:332–7.

    Article  Google Scholar 

  14. HD-200 Consortium: The ADHD-200 Consortium: A Model to Advance the Translational Potential of Neuroimaging in Clinical Neuroscience. Front Syst Neurosci 2012, 6:62.

  15. Elton A, Alcauter S, Gao W. Network connectivity abnormality profile supports a categorical-dimensional hybrid model of ADHD. Hum Brain Mapp. 2014;35:4531–43.

    Article  Google Scholar 

  16. Wang XH, Jiao Y, Li L. Predicting clinical symptoms of attention deficit hyperactivity disorder based on temporal patterns between and within intrinsic connectivity networks. Neuroscience. 2017;362:60–9.

    Article  CAS  Google Scholar 

  17. Nomi JS, Schettini E, Voorhies W, Bolt TS, Heller AS, Uddin LQ. Resting-state brain signal variability in prefrontal cortex is associated with ADHD symptom severity in children. Front Hum Neurosci. 2018;12:90.

    Article  Google Scholar 

  18. Philipsen A, Jans T, Graf E, Matthies S, Borel P, Colla M, Gentschow L, Langner D, Jacob C, Groß-Lesch S, Sobanski E, Alm B, Schumacher-Stien M, Roesler M, Retz W, Retz-Junginger P, Kis B, Abdel-Hamid M, Heinrich V, Huss M, Kornmann C, Bürger A, Perlov E, Ihorst G, Schlander M, Berger M, Tebartz van Elst L. Comparison of methylphenidate and psychotherapy in adult ADHD study (COMPAS) consortium: effects of group psychotherapy, individual counseling, methylphenidate, and placebo in the treatment of adult attention-deficit/hyperactivity disorder: a randomized clinical trial. JAMA Psychiatry. 2015;72:1199–210.

    Article  Google Scholar 

  19. Bachmann K, Lam AP, Philipsen A. Mindfulness-based cognitive therapy and the adult ADHD brain: a Neuropsychotherapeutic perspective. Front Psychiatry. 2016;7:117.

    Article  Google Scholar 

  20. Cocchi L, Bramati IE, Zalesky A, Furukawa E, Fontenelle LF, Moll J, Tripp G, Mattos P. Altered functional brain connectivity in a non-clinical sample of young adults with attention-deficit/hyperactivity disorder. J Neurosci. 2012;32:17753–61.

    Article  CAS  Google Scholar 

  21. Braun U, Schaefer A, Betzel RF, Tost H, Meyer-Lindenberg A, Bassett DS. From maps to multi-dimensional network mechanisms of mental disorders. Neuron. 2018;97:14–31.

    Article  CAS  Google Scholar 

  22. Nickerson LD, Smith SM, Öngür D, Beckmann CF. Using dual regression to investigate network shape and amplitude in functional connectivity analyses. Front Neurosci. 2017;11:115.

    Article  Google Scholar 

  23. Sörös P, Bachmann K, Lam AP, Kanat M, Hoxhaj E, Matthies S, Feige B, Müller HHO, Thiel C, Philipsen A. Inattention predicts increased thickness of left occipital cortex in men with attention-deficit/hyperactivity disorder. Front Psychiatry. 2017;8:170.

    Article  Google Scholar 

  24. Bachmann K, Lam AP, Sörös P, Kanat M, Hoxhaj E, Matthies S, Feige B, Müller H, Özyurt J, Thiel CM, Philipsen A. Effects of mindfulness and psychoeducation on working memory in adult ADHD: a randomised, controlled fMRI study. Behav Res Ther. 2018;106:47–56.

    Article  Google Scholar 

  25. Hoxhaj E, Sadohara C, Borel P, D'Amelio R, Sobanski E, Müller H, Feige B, Matthies S, Philipsen A. Mindfulness vs psychoeducation in adult ADHD: a randomized controlled trial. Eur Arch Psychiatry Clin Neurosci. 2018.

  26. Jenkinson M, Bannister P, Brady M, Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage. 2002;17:825–41.

    Article  Google Scholar 

  27. Satterthwaite TD, Wolf DH, Loughead J, Ruparel K, Elliott MA, Hakonarson H, Gur RC, Gur RE. Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youth. Neuroimage. 2012;60:623–32.

    Article  Google Scholar 

  28. Mostert JC, Shumskaya E, Mennes M, Onnink AM, Hoogman M, Kan CC, Arias Vasquez A, Buitelaar J, Franke B, Norris DG. Characterising resting-state functional connectivity in a large sample of adults with ADHD. Prog Neuro-Psychopharmacol Biol Psychiatry. 2016;67:82–91.

    Article  Google Scholar 

  29. Conners CK, Erhardt D, and Sparrow E: CAARS. Conners’ Adult ADHD Rating Scales. Toronto, Canada: Multi-Health Systems; 1999.

  30. Christiansen H, Hirsch O, Philipsen A, Oades RD, Matthies S, Hebebrand J, Ueckermann J, Abdel-Hamid M, Kraemer M, Wiltfang J, Graf E, Colla M, Sobanski E, Alm B, Rösler M, Jacob C, Jans T, Huss M, Schimmelmann BG, Kis B. German validation of the conners adult ADHD rating scale-self-report: confirmation of factor structure in a large sample of participants with ADHD. J Atten Disord. 2013;17:690–8.

    Article  Google Scholar 

  31. Wittchen H, Zaudig M, Fydrich T, Strukturiertes Klinisches SKID. Interview für DSM-IV. Achse I und II. Handanweisung. Göttingen: Hogrefe; 1997.

    Google Scholar 

  32. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, Bannister PR, De Luca M, Drobnjak I, Flitney DE, Niazy RK, Saunders J, Vickers J, Zhang Y, De Stefano N, Brady JM, Matthews PM. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage. 2004;23(Suppl 1):S208–19.

    Article  Google Scholar 

  33. Woolrich MW, Jbabdi S, Patenaude B, Chappell M, Makni S, Behrens T, Beckmann C, Jenkinson M, Smith SM. Bayesian analysis of neuroimaging data in FSL. Neuroimage. 2009;45:S173–86.

    Article  Google Scholar 

  34. Jenkinson M, Beckmann CF, Behrens TE, Woolrich MW, Smith SM: FSL. Neuroimage 2012, 62:782–790.

  35. Smith SM. Fast robust automated brain extraction. Hum Brain Mapp. 2002;17:143–55.

    Article  Google Scholar 

  36. Beckmann CF, Smith SM. Probabilistic independent component analysis for functional magnetic resonance imaging. IEEE Trans Med Imaging. 2004;23:137–52.

    Article  Google Scholar 

  37. Pruim RH, Mennes M, van Rooij D, Llera A, Buitelaar JK, Beckmann CF. ICA-AROMA: a robust ICA-based strategy for removing motion artifacts from fMRI data. Neuroimage. 2015;112:267–77.

    Article  Google Scholar 

  38. Pruim RH, Mennes M, Buitelaar JK, Beckmann CF. Evaluation of ICA-AROMA and alternative strategies for motion artifact removal in resting state fMRI. Neuroimage. 2015;112:278–87.

    Article  Google Scholar 

  39. Carone D, Licenik R, Suri S, Griffanti L, Filippini N, Kennedy J. Impact of automated ICA-based denoising of fMRI data in acute stroke patients. Neuroimage Clin. 2017;16:23–31.

    Article  CAS  Google Scholar 

  40. Greve DN, Fischl B. Accurate and robust brain image alignment using boundary-based registration. Neuroimage. 2009;48:63–72.

    Article  Google Scholar 

  41. Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, Smith SM, Beckmann CF, Adelstein JS, Buckner RL, Colcombe S, Dogonowski AM, Ernst M, Fair D, Hampson M, Hoptman MJ, Hyde JS, Kiviniemi VJ, Kötter R, Li SJ, Lin CP, Lowe MJ, Mackay C, Madden DJ, Madsen KH, Margulies DS, Mayberg HS, McMahon K, Monk CS, Mostofsky SH, Nagel BJ, Pekar JJ, Peltier SJ, Petersen SE, Riedl V, Rombouts SA, Rypma B, Schlaggar BL, Schmidt S, Seidler RD, Siegle GJ, Sorg C, Teng GJ, Veijola J, Villringer A, Walter M, Wang L, Weng XC, Whitfield-Gabrieli S, Williamson P, Windischberger C, Zang YF, Zhang HY, Castellanos FX, Milham MP. Toward discovery science of human brain function. Proc Natl Acad Sci U S A. 2010;107:4734–9.

    Article  CAS  Google Scholar 

  42. Laird AR, Fox PM, Eickhoff SB, Turner JA, Ray KL, McKay DR, Glahn DC, Beckmann CF, Smith SM, Fox PT. Behavioral interpretations of intrinsic connectivity networks. J Cogn Neurosci. 2011;23:4022–37.

    Article  Google Scholar 

  43. Filippini N, MacIntosh BJ, Hough MG, Goodwin GM, Frisoni GB, Smith SM, Matthews PM, Beckmann CF, Mackay CE. Distinct patterns of brain activity in young carriers of the APOE-epsilon4 allele. Proc Natl Acad Sci U S A. 2009;106:7209–14.

    Article  CAS  Google Scholar 

  44. Nichols TE, Holmes AP. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum Brain Mapp. 2002;15:1–25.

    Article  Google Scholar 

  45. Winkler AM, Ridgway GR, Webster MA, Smith SM, Nichols TE. Permutation inference for the general linear model. Neuroimage. 2014;92:381–97.

    Article  Google Scholar 

  46. Smith SM, Nichols TE. Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference. Neuroimage. 2009;44:83–98.

    Article  Google Scholar 

  47. Sala-Llonch R, Bartrés-Faz D, Junqué C. Reorganization of brain networks in aging: a review of functional connectivity studies. Front Psychol. 2015;6:663.

    Article  Google Scholar 

  48. Mak LE, Minuzzi L, MacQueen G, Hall G, Kennedy SH, Milev R. The default mode network in healthy individuals: a systematic review and meta-analysis. Brain Connect. 2017;7:25–33.

    Article  Google Scholar 

  49. Gunaydin LA, Kreitzer AC. Cortico-basal ganglia circuit function in psychiatric disease. Annu Rev Physiol. 2016;78:327–50.

    Article  CAS  Google Scholar 

  50. Jahanshahi M, Obeso I, Rothwell JC, Obeso JA. A fronto-striato-subthalamic-pallidal network for goal-directed and habitual inhibition. Nat Rev Neurosci. 2015;16:719–32.

    Article  CAS  Google Scholar 

  51. Cubillo A, Halari R, Smith A, Taylor E, Rubia K. A review of fronto-striatal and fronto-cortical brain abnormalities in children and adults with attention deficit hyperactivity disorder (ADHD) and new evidence for dysfunction in adults with ADHD during motivation and attention. Cortex. 2012;48:194–215.

    Article  Google Scholar 

  52. Sebastian A, Gerdes B, Feige B, Klöppel S, Lange T, Philipsen A, Tebartz van Elst L, Lieb K, Tüscher O. Neural correlates of interference inhibition, action withholding and action cancelation in adult ADHD. Psychiatry Res. 2012;202:132–41.

    Article  Google Scholar 

  53. Hart H, Radua J, Nakao T, Mataix-Cols D, Rubia K. Meta-analysis of functional magnetic resonance imaging studies of inhibition and attention in attention-deficit/hyperactivity disorder: exploring task-specific, stimulant medication, and age effects. JAMA Psychiatry. 2013;70:185–98.

    Article  Google Scholar 

  54. Larsson H, Anckarsater H, Råstam M, Chang Z, Lichtenstein P. Childhood attention-deficit hyperactivity disorder as an extreme of a continuous trait: a quantitative genetic study of 8,500 twin pairs. J Child Psychol Psychiatry. 2012;53:73–80.

    Article  Google Scholar 

  55. Faraone SV, Asherson P, Banaschewski T, Biederman J, Buitelaar JK, Ramos-Quiroga JA, Rohde LA, Sonuga-Barke EJ, Tannock R, Franke B. Attention-deficit/hyperactivity disorder. Nat Rev Dis Primers. 2015;1:15020.

    Article  Google Scholar 

  56. Chabernaud C, Mennes M, Kelly C, Nooner K, Di Martino A, Castellanos FX, Milham MP. Dimensional brain-behavior relationships in children with attention-deficit/hyperactivity disorder. Biol Psychiatry. 2012;71:434–42.

    Article  Google Scholar 

  57. Oldehinkel M, Beckmann CF, Pruim RH, van Oort ES, Franke B, Hartman CA, Hoekstra PJ, Oosterlaan J, Heslenfeld D, Buitelaar JK, Mennes M. Attention-deficit/hyperactivity disorder symptoms coincide with altered striatal connectivity. Biol Psychiatry Cogn Neurosci Neuroimaging. 2016;1:353–63.

    Article  Google Scholar 

  58. Sanefuji M, Craig M, Parlatini V, Mehta MA, Murphy DG, Catani M, Cerliani L, Thiebaut de Schotten M. Double-dissociation between the mechanism leading to impulsivity and inattention in attention deficit hyperactivity disorder: a resting-state functional connectivity study. Cortex. 2016.

  59. Uddin LQ, Kelly AM, Biswal BB, Margulies DS, Shehzad Z, Shaw D, Ghaffari M, Rotrosen J, Adler LA, Castellanos FX, Milham MP. Network homogeneity reveals decreased integrity of default-mode network in ADHD. J Neurosci Methods. 2008;169:249–54.

    Article  Google Scholar 

  60. Battel L, Kieling RR, Kieling C, Anés M, Aurich NK, da Costa JC, Rohde LA, Franco AR. Intrinsic brain connectivity following long-term treatment with methylphenidate in children with attention-deficit/hyperactivity disorder. J Child Adolesc Psychopharmacol. 2016;26:555–61.

    Article  CAS  Google Scholar 

  61. Pretus C, Ramos-Quiroga JA, Richarte V, Corrales M, Picado M, Carmona S, Vilarroya Ó. Time and psychostimulants: opposing long-term structural effects in the adult ADHD brain. A longitudinal MR study. Eur Neuropsychopharmacol. 2017;27:1238–47.

    Article  CAS  Google Scholar 

  62. O'Halloran CJ, Kinsella GJ, Storey E. The cerebellum and neuropsychological functioning: a critical review. J Clin Exp Neuropsychol. 2012;34:35–56.

    Article  Google Scholar 

  63. Barth M, Breuer F, Koopmans PJ, Norris DG, Poser BA. Simultaneous multislice (SMS) imaging techniques. Magn Reson Med. 2016;75:63–81.

    Article  Google Scholar 

Download references

Acknowledgments

We thank Dr. Marc Löwer, Manfred Weber, and Helena Frommberger for their clinical engagement.

Funding

This study was partially funded by the German Federal Ministry of Education and Research (BMBF, 01GV0606).

Availability of data and materials

The datasets used and analyzed during the current study are available from the senior author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

PS analyzed the data, prepared the figures, and wrote the manuscript. EH, PB, CS, BF and SM were involved in the design of the study and collected the data. KB was involved in data preparation and literature search. HHOM and MS read and revised the manuscript. AP conceptualized and supervised the study. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Peter Sörös.

Ethics declarations

Ethics approval and consent to participate

The study has been approved by the Ethics Committee of the Faculty of Medicine, University of Freiburg, Germany. All participants provided written informed consent.

Consent for publication

Not applicable.

Competing interests

AP declares that she served on advisory boards, gave lectures, performed phase 3 studies, or received travel grants within the last 5 years from Eli Lilly and Co, Lundbeck, MEDICE Arzneimittel, Pütter GmbH and Co KG, Novartis, Servier, and Shire; and has authored books and articles on ADHD published by Elsevier, Hogrefe, Schattauer, Kohlhammer, Karger, and Springer.

The other authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Appendix 1. Overview of the 10 independent components that were not used for further analysis. (PDF 309 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sörös, P., Hoxhaj, E., Borel, P. et al. Hyperactivity/restlessness is associated with increased functional connectivity in adults with ADHD: a dimensional analysis of resting state fMRI. BMC Psychiatry 19, 43 (2019). https://doi.org/10.1186/s12888-019-2031-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12888-019-2031-9

Keywords