- Study protocol
- Open Access
Youth at-risk for serious mental illness: methods of the PROCAN study
BMC Psychiatry volume 18, Article number: 219 (2018)
Most mental disorders begin in adolescence; however, there are gaps in our understanding of youth mental health. Clinical and policy gaps arise from our current inability to predict, from amongst all youth who experience mild behavioural disturbances, who will go on to develop a mental illness, what that illness will be, and what can be done to change its course and prevent its worsening to a serious mental illness (SMI). There are also gaps in our understanding of how known risk factors set off neurobiological changes that may play a role in determining who will develop a SMI. Project goals are (i) to identify youth at different stages of risk of SMI so that intervention can begin as soon as possible and (ii) to understand the triggers of these mental illnesses.
This 2-site longitudinal study will recruit 240 youth, ages 12–25, who are at different stages of risk for developing a SMI. The sample includes (a) healthy individuals, (b) symptom-free individuals who have a first-degree relative with a SMI, (c) youth who are experiencing distress and may have mild symptoms of anxiety or depression, and (d) youth who are already demonstrating attenuated symptoms of SMI such as bipolar disorder or psychosis. We will assess, every 6 months for one year, a wide range of clinical and psychosocial factors to determine which factors can be used to predict key outcomes. We will also assess neuroimaging and peripheral markers. We will develop and validate a prediction algorithm that includes demographic, clinical and psychosocial predictors. We will also determine if adding biological markers to our algorithm improves prediction.
Outcomes from this study include an improved clinical staging model for SMI and prediction algorithms that can be used by health care providers as decision-support tools in their practices. Secondly, we may have a greater understanding of clinical, social and cognitive factors associated with the clinical stages of development of a SMI, as well as new insights from neuroimaging and later neurochemical biomarker studies regarding predisposition to SMI development and progression through the clinical stages of illness.
There has been a great deal of focus on risk for psychosis with many studies focussing on young people who are at clinical high risk of psychosis . However, serious mental illness (SMI), in general, including bipolar disorder and recurrent major depression along with psychosis has drastic individual, family and societal consequences. It is important to address the risk for any SMI in youth because (i) most mental disorders begin in adolescence, with 75% of chronic and persistent SMI starting between the ages of 10 and 24 , (ii) mental disorders are the main cause of years lost due to ill health, disability or early death for this age group , (iii) it is hard for young people with SMI to recover function, resulting in impaired quality-of-life, medical morbidity and suicide, at a cost, for example in Canada, of over $50 billion per year.
Many gaps exist in our understanding of youth origins of SMI. First, we do not know how to identify youth at risk of SMI. Second, we do not know how best to define the stage of illness so that relevant, targeted preventive services can be offered. Third, we do not have the capacity to predict who will develop an SMI, what that illness might be, and what can be done to change its trajectory. Finally, we do not know how risk factors precipitate the neurobiological changes that determine who will develop a SMI. These are critically important questions regarding how, when and why youth transition from being healthy children to young adults with life-long illnesses.
We are studying a cohort of youth at various stages of risk for developing SMI by using a clinical staging model of mental disorders [4, 5]. The natural history of major mental disorders, such as psychosis, bipolar disorder and recurrent depression, is theorized to consist of transitions from being asymptomatic (i.e., having genetic risk but no symptoms) (stage 0) to a stage of undifferentiated general symptoms (stage 1a) to a worsening of existing symptoms or acquisition of new symptoms, whereby the person appears to have an attenuated form of a distinguishable mental disorder (stage 1b) until eventually (for some) a threshold diagnosis is reached (stages 2–4) (See Table 1). In other medical specialities, in particular oncology, [6, 7] staging models have been successful in integrating imaging, histology and molecular biology. Clinical staging can inform prognosis, clinical course and treatment, and assist with individualization of care but has not yet been tested in the field of mental health [4, 5]. Thus, our project is unique in that we will define our sample according to this stage model which allows for the inclusion of youth with transient mental illness who have important immediate health care needs and accompanying disability.
This paper presents the methodology of our Brain Canada-funded project, the Adolescent Mental Health: Canadian Psychiatric Risk and Outcome (PROCAN) study in conjunction with the Canadian Biomarker Integration Network in Depression (CAN-BIND) through the Ontario Brain Institute (OBI) that began in January 2015 with data collection beginning in April 2015. Our work addresses two key concerns in the field of youth mental health. First, the clinical presentation of youth with mental illness is frequently characterized by heterogeneous symptom patterns that are often comorbid with substance misuse. Early manifestations of potential illness are often brief or undifferentiated, and symptoms may emerge years before distinct diagnosable disorders . These manifestations can be disabling even before they become full-blown disorders . Because of a current emphasis on formal diagnosis at the individual and service level, youth with early symptoms are marginalized with delayed and/or limited treatment access. Even when young people receive “a diagnosis”, that diagnosis frequently changes [10,11,12], emphasizing the importance of studying the evolution of SMI broadly rather than in a diagnosis-specific manner.
The second key concern is that SMI has a multi-factorial aetiology, resulting from interactions among clinical, psychosocial and biological factors. In recent years, epidemiological studies, e.g. [13, 14], have demonstrated that the accumulation of stressors (trauma, abuse, bullying, etc.) and the early use of cannabis in adolescence are associated with an increased propensity for the development of SMI (in particular schizophrenia and mood disorders) . These risk factors interact and may synergistically combine with pre-existing liabilities, including genetic and other biological factors.
There are four main sets of objectives of the PROCAN project: clinical, neuroimaging, developing prediction models and defining peripheral biomarkers. The clinical objectives include improving our ability to identify youth at risk of SMI by determining clinical, social and cognitive factors associated with different stages of risk. Secondly, we aim to better understand factors that predict key outcomes, such as advancing disability, secondary substance misuse, non-participation in education and employment, and new self-harm. The imaging objectives first aim to identify structural and functional correlates of a predisposition to develop a SMI, and secondly, to understand how progression through the clinical stages of illness is associated with progressive brain changes. For our third set of objectives we aim first to develop a prediction model that predicts transition to illness or even the transition to a more serious stage of risk. We also aim to determine whether incorporating imaging data with clinical data improves the predictive value of the prediction model. Finally, we aim to explore potential peripheral biomarkers. This is being carried out in collaboration with CAN-BIND . This collaboration involves collecting blood samples, according to the CAN-BIND protocol, for proteomic, epigenetic and genomic analyses, maximizing the opportunity to identify novel peripheral biomarkers of a predisposition to develop SMI.
From this cohort, clinical, social and cognitive data, as well as imaging data is gathered to create a multi-layered, comprehensive “snapshot” of these youth that will be employed to develop algorithms that predict the development of SMI.
Recruitment procedures include distributing materials describing the study and presentations to all clinical agencies that might be seeing youth who are help seeking, school counsellors and school social workers. We advertised widely in local papers and offered presentations to the general public and relevant youth groups. The sample is a cohort of 240 adolescents and young adults (aged 12–25, male and female) that includes youth with early mood symptoms or sub-threshold psychotic symptoms (symptomatic group; n = 160), youth at risk due to a family history of a SMI (family high risk (FHR); n = 40), and healthy controls (HC; n = 40). The stage of risk is defined based on the clinical staging model presented in Table 1.
Exclusion criteria for all participants include the following: (i) meet criteria for current or lifetime Axis I bipolar or psychotic disorder (other Axis I disorders will not be exclusionary as they may be precursors to mood or psychotic disorders); (ii) IQ < 70; (iii) past or current history of a significant central nervous system disorder or serious medical disorder; and (iv) current pharmacological treatment that would be considered as an adequate trial of treatment for a SMI.
For the symptomatic group (N = 160), we are recruiting approximately 80 individuals who meet criteria for stage 1a and 80 for stage 1b (see Table 1). Stage 1a will comprise those who meet criteria for distress disorder based on published ranges of the Kessler 10 (K-10) Distress Scale , a broad measure of psychological distress, with consideration of additional measures, e.g., Beck Depression Scale, Social Interaction Anxiety Scale (SIAS), Social Anxiety Scale (SAS) (see Table 2), to delineate anxiety and depression symptoms. Within this group, participants will have ratings on other measures to define their particular symptoms. For stage 1b participants, scores above threshold on measures such as the Scale of Prodromal Symptoms (SOPS), and the Calgary Depression Scale for Schizophrenia (CDSS), which identify those with clinical high-risk features for specific mental disorders, will be added to the K-10 score. In the FHR and HC groups, none of the participants will meet any of the criteria for stages 1a and 1b. The FHR group will include those with a first-degree relative with a psychotic disorder, bipolar disorder or recurrent mood disorder (stage 0). This distribution allows for a more heterogeneous sample, which not only fits better with our aims but also with recent research policy, in particular with the Research Domain Criteria  by addressing particular groups of “patients” that are not based on standard diagnoses. This “allows for a sample that provides appropriate variance along a dimension of interest” (p.813) .
There is no standard formula for calculating the sample size needed to develop a prediction model. Therefore, we followed the guidelines from Peduzzi et al. To maintain accuracy and precision and to minimize bias, we plan to use the number of events per variable of 10 as the guiding rule. In this study 200 participants with sub-threshold symptoms and/or family history will be recruited. Assuming that the risk of transition from the clinical high-risk stage to SMI is 35% over 2.5 years, [21, 22] 70 events would be expected, which ensure sufficient power for developing a model with 6 predictors.
Two hundred participants are being recruited from the University of Calgary site, with an additional 40 being recruited from Sunnybrook Health Sciences Centre, in Toronto.
The study was approved by The University of Calgary Conjoint Health Research Ethics Board (ID:REB 14–1710) and the Sunnybrook Research Ethics Board (ID:100–2015). Participants provided informed consent or assent (parental informed consent for minors).
Individuals who respond to recruitment efforts are screened by telephone and, if suitable, invited to an in-person assessment to evaluate inclusion and exclusion criteria. Those who are eligible and interested sign informed consent; in the case of minors, this is obtained from parents/guardians. Standard procedures are followed to ensure confidentiality. Participants are assessed at baseline on all measures, followed by short clinical assessments at 6 and 12 months. Scanning and blood draws occur in conjunction with baseline and 12-month assessments. If, at any point, a participant makes a transition to a SMI, we repeat the imaging and blood draws in addition to the clinical assessment.
Clinical measures were selected based on their relevance, excellent psychometric properties, utility as repeated measures, suitability for adolescents, and participant tolerability. The Structured Clinical Interview for DSM-V Disorders (SCID)  is used to determine the presence of any Axis I disorder. All assessment measures are presented in the Schedule of Events (Table 2) and include the following domains: psychopathology; social and role functioning; past and current stressors; substance use; cognition; and beliefs/attitudes. Comprehensive treatment logs of all past and current psychosocial and pharmacological treatments are recorded. We also measure Body Mass Index (BMI) and blood pressure in order to better understanding associations between SMI and medical comorbidity.
All clinical raters, under the supervision of Drs. Addington and Goldstein, are required to complete a rigorous protocol for training, standardization of procedures and maintenance of reliability developed for previous multi-site projects . At weekly conference calls with all raters, led by Dr. Addington, written comprehensive vignettes will be presented for each participant to determine consensus on that participant’s clinical stage.
The neuroimaging component aims to determine whether baseline brain structure and function can distinguish youth who will develop SMI from those who will not. Algorithms exist that identify individual patients with neurologic and psychiatric disorders based on integrated neuroimaging and clinical data. This approach involves identifying a set of features from the data collected that show significant differences between symptomatic participants and controls. Such features may be drawn from clinical data (e.g., standardized scales), structural MRI or diffusion MRI (e.g., regional grey matter volume, white matter integrity), functional data (e.g., resting-state connectivity among brain regions of interest or task-related signal changes) or some combination of all three. These feature sets are then used to train automated pattern-recognition algorithms such as Support Vector Machines (SVMs), enabling them to classify individual scans as normal or pathological. Such methods have been successfully applied to distinguish healthy controls from patients with schizophrenia, bipolar disorder, Alzheimer’s disease, and major depressive disorder [25,26,27]. The same techniques are expected to prove useful in predicting outcome in patients at risk for developing SMI .
Functional Magnetic Resonance Imaging (fMRI) will be collected both while participants are resting passively (resting state; rs-fMRI) and during a series of tasks. The fMRI tasks have been chosen to engage cognitive, cognitive-emotional networks and cortico-striatal reward circuits. Analyses will assess task-dependent blood oxygenation level-dependent (BOLD) signal change and functional connectivity in these regions. fMRI will assess changes in functional connectivity in striatal-hippocampal, amygdala-PFC and cortico-thalamo-striatal networks.
Diffusion Tensor Imaging (DTI) and advanced diffusion models (e.g. Neurite orientation dispersion and density imaging (NODDI) and diffusion kurtosis imaging) will be used to examine changes in structural links between these and other regions. In psychiatric illness, wide-spread reductions in white matter (WM) integrity have been observed; however, the stage at which these abnormalities first appear, and whether they are correlates of illness progression, as opposed to an increased vulnerability remains unclear. In individuals at risk for SMI, for instance those at risk for psychosis, widespread WM aberrations have been observed in multiple brain regions , with fronto-temporal and fronto-limbic connections, including the superior longitudinal and uncinate fasciculus and corpus callosum particularly implicated .
Arterial spin labeling (ASL) perfusion MRI measures regional cerebral blood flow (rCBF), and may be used to study subtle brain perfusion changes occurring in psychiatric illnesses.  Abnormalities in microvasculature can result in functional deficits because of the coupling between neuronal firing rates and blood oxygen consumption , thus providing useful knowledge of brain areas with disease-related abnormalities in cerebral microvasculature function. Perfusion patterns may hold promise as objective biomarkers by assessing whether rCBF patterns differ in at-risk groups. Adolescents with mood disorders, for example, appear to differ from healthy adolescents on rCBF in executive, affective and motor networks .
Participants undergo 3 T MRI at baseline and the 12-month follow-up. Sessions consist of structural and functional neuroimaging sequences comprising the following:
Whole-brain T1-weighted anatomical scan at 1mm3 resolution;
Whole-brain diffusion imaging using 45 gradient directions and 32 gradient directions at UCA and SB, respectively, each at 2 b-values (2500 and 1000 s/mm2) with 16 images at b = 0 s/mm2 for tensor construction;
3D pseudo continuous ASL perfusion MRI sequence;
A 10-min resting-state functional neuroimaging scan during which participants are instructed to keep their eyes open and focus on a fixation cross. Images are obtained using a whole-brain T2*-sensitive BOLD echo planar imaging (EPI) series;
Task-based functional neuroimaging (BOLD series) which focus on the integration of emotional and cognitive function (emotional go/no go task), and categorical learning task (monetary incentive delay task) along with a working memory task.
This study affords the opportunity to collect biochemical information from carefully characterized clinical subjects that can cast light on the neural mechanisms by which exposure to stress and substance use during adolescence promote the development of SMI. We collect DNA, RNA and plasma protein samples at specific intervals (Table 2) and transfer these to CAN-BIND for storage. Under the rubric of CAN-BIND we will complete genomic, epigenetic and proteomic analyses. These analyses may include profiling of mRNA and miRNA, histone modifications, methylation status across the genome wide assessment of DNA. Other possible analyses are oxidative damage to DNA,  and Selected Reaction Monitoring proteomic assays that can allow systematic exploration of biological pathways thought to be involved in SMI.
We will first develop and validate a prediction algorithm that includes demographic, clinical and psychosocial predictors. Transition to SMI over the study period will be the outcome variable. Such an algorithm can be feasibly employed at the clinical assessment stage. Next, we will develop a second algorithm that includes neuroimaging data along with demographic, clinical and psychosocial predictors. We hypothesize that this algorithm will have greater discriminative power than the first one, while acknowledging that this has not been the case in all reports. The rationale for having two separate prediction models is that brain imaging is expensive and may not be an efficient use of resources to conduct such assessments in every patient. If individuals are found to be at high risk based on the first algorithm, neuroimaging may be recommended. Using the second model, the risk of developing SMI can be more precisely and objectively predicted.
The longitudinal data may (i) have missing values, (ii) have highly correlated predictors, and (iii) violate the assumptions of a particular modelling approach. For variables with missing values, the mechanisms of missing data will be examined to determine whether a multiple imputation method is appropriate. For highly correlated predictors, we will keep the one that is clinically relevant, feasible for routine data collection, and that adds more predictive power to the model. For model development, we will use the Cox proportional hazard model, which is a time-to-event model that has been widely used in prediction research. If the assumption of proportionality is violated, we will use other approaches, including the accelerated failure time model, which does not require the assumption of proportionality , the repeated measures discriminant analysis model, which can accommodate within-predictor and between-predictor correlations, or a machine learning approach that can compare performance of models developed using different approaches.
First prediction algorithm
Our prediction model will include six predictors or less so that it can be of practical use and minimize potential problems related to over-fitting and instability. The potential predictors will be the summary scores from the selected instruments that measure clinical symptoms, social functioning, substance use, cognition and adjustment, as outlined in Table 2. The initial selection of candidate predictors will be informed by the statistical analyses of the cohort project, literature review and knowledge about the clinical relevance of the variables. We will use combined procedures of forward and backward selection for model development, as each individual approach has its own limitations . We will first include current clinical stage and cannabis use in the model. We will then examine other candidate predictors to determine whether they improve the model’s discriminative power and calibration with data by comparing the difference between the C statistics of the models with and without the variable. Calibration measures how closely predicted outcomes agree with actual outcomes. For this, we will use the Hosmer-Lemeshow test to compare the differences between mean predicted and actual event rates. We will also use the method of Net Reclassification Improvement  to examine whether adding a particular variable could correctly reclassify participants into appropriate categories. Once the prediction model is developed, we will conduct bootstrap validation by repeatedly resampling from the original data with replacement and estimate the accuracy of the prediction algorithm. Because similar demographic, clinical and psychosocial data have been collected in the North American Prodrome Longitudinal Study (NAPLS) study, we will use the data from the US sites of the NAPLS consortium to validate the first prediction algorithm. The proposed analytic procedures are consistent with the framework of Prognosis Research Strategy [38, 39] and methodology that is commonly used in prediction research [37, 40].
Second prediction algorithm
This algorithm will be used for more precise and objective prediction with imaging markers in those at high-risk based on the first model. The neuroimaging group will identify a set of structural and functional features that differentiate healthy controls, converters and non-converters. We will use the same model-fitting strategies as described above. We will examine whether adding the predictors to the first model will improve discrimination without compromising calibration. If the second model can yield more precise prediction than the first one, we will conduct a preliminary analysis on the cost-benefit of using the two models for prediction and intervention planning.
Finally, if potentially relevant neurochemical biomarkers are later identified these will be added to the second prediction algorithm as described above.
This paper has described the details and methods of the Adolescent Mental Health: Canadian Psychiatric Risk and Outcome (PROCAN) study. This project has several unique features: (i) using a staging model to define level of risk in a diagnostically unconstrained sample; (ii) developing prediction algorithms for transition to illness that could have clinical utility; and (iii) incorporating neuroimaging data into clinical algorithms to assess the additional predictive value of neuroimaging.
Prediction algorithms are tools that combine a key set of known predictors from which the risk of future disease can be calculated for individual patients . They aid health professionals and individuals in making informed decisions. Well-known examples include the Framingham risk prediction algorithms for cardiovascular disease  and for cancer risk. [42, 43] However, their use for psychiatric care lags far behind cardiology and oncology [44,45,46]. Moreover, no attempts have been made to investigate the roles of neurobiological and genetic markers in prediction models for SMI.
There are several important outcomes that may result from this project. First results may lead to an improved clinical staging model for SMI and prediction algorithms that can be used by health care providers as decision-support tools in their practices. Secondly, our research will lead to a greater understanding of clinical, social and cognitive factors associated with the clinical stages of development of a SMI, as well as new insights from neuroimaging and later neurochemical biomarker studies regarding predisposition to SMI development and progression through the clinical stages of illness. Our results will also be used to inform health policies, health education and promotion activities that are related to the predictors in the algorithms. Serious mental illness results in impaired quality-of-life, medical morbidity and suicide. Improved identification of youth at risk represents our best chance at providing effective, appropriate and cost-effective treatment to each young person who needs help.
Arterial spin labeling
Body mass index
Blood oxygenation level-dependent
Canadian biomarker integration network in depression
Calgary depression scale for schizophrenia
Diffusion tensor imaging
Echo planar imaging
Family high risk
Functional magnetic resonance imaging
Kessler 10 distress scale
North American prodrome longitudinal study
Neurite orientation dispersion and density imaging
Ontario brain Institute
Adolescent mental health: Canadian psychiatric risk and outcome
Regional cerebral blood flow
Resting state functional magnetic resonance imaging
Social anxiety scale
Structured clinical interview for DSM-V disorders
Social interaction anxiety scale
Serious mental illness
Scale of prodromal symptoms
Support vector machines
Fusar-Poli P, Borgwardt S, Bechdolf A, Addington J, Riecher-Rossler A, Schultze-Lutter F, et al. The psychosis high-risk state: a comprehensive state-of-the-art review. Arch Gen Psychiatry. 2012:1–14.
de Girolamo G, Dagani J, Purcell R, Cocchi A, McGorry PD. Age of onset of mental disorders and use of mental health services: needs, oppotunities and obstacles. Epidemiol Psychiatr Sci. 2012;21:47–57.
Gore FM, Bloem PJ, Patton GC. Global burden of disease in young people aged 10-24 years: a systematic analysis. Lancet. 2011;377:2093–102.
Hickie IB, Scott EM, Hermens DF, Naismith SL, Guastella AJ, Kaur M, et al. Applying clinical staging to young people who present for mental health care. Early Interv Psychiatry. 2012;
McGorry PD. Early clinical phenotypes, clinical staging, and strategic biomarker research: building blocks for personalized psychiatry. Biol Psychiatry. 2013;74:394–5.
Muller-Quernheim J. Sarcoidosis: clinical manifestations, staging and therapy (part II). Respir Med. 1998;92:140–9.
Mader JT, Shirtliff M, Calhoun JH. Staging and staging application in osteomyelitis. Clin Infect Dis. 1997;25:1303–9.
van Os J, Linscott RJ, Myin-Germeys I, Delespaul P, Krabbendam L. A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol Med. 2009;39:179–95.
Purcell R, Jorm AF, Hickie IB, Yung AR, Pantelis C, Amminger GP, et al. Transitions study of predictors of illness progression in young people with mental ill health: study methodology. Early Interv Psychiatry. 2013;
Addington J, Chaves A, Addington D. Diagnostic stability over one year in first-episode psychosis. Schizophr Res. 2006;86:71–5.
Kessing LV. Diagnostic stability in bipolar disorder in clinical practise as according to ICD-10. J Affect Disord. 2005;85:293–9.
Kessing LV. Diagnostic stability in depressive disorder as according to ICD-10 in clinical practice. Psychopathology. 2005;38:32–7.
Arseneault L, Cannon M, Fisher HL, Polanczyk G, Moffitt TE, Caspi A. Childhood trauma and children's emerging psychotic symptoms: a genetically sensitive longitudinal cohort study. Am J Psychiatry. 2011;168:65–72.
Zammit S, Lewis G, Dalman C, Allebeck P. Examining interactions between risk factors for psychosis. Br J Psychiatry. 2010;197:207–11.
van OJ, Rutten BP, Poulton R. Gene-environment interactions in schizophrenia: review of epidemiological findings and future directions. Schizophr Bull. 2008;34:1066–82.
Lam RW, Milev R, Rotzinger S, Andreazza AC, Blier P, Brenner C, et al. Discovering biomarkers for antidepressant response: protocol from the Canadian biomarker integration network in depression (CAN-BIND) and clinical characteristics of the first patient cohort. BMC Psychiatry. 2016;16:105.
Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32:959–76.
Cuthbert BN, Insel TR. Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Med. 2013;11:126.
Casey BJ, Craddock N, Cuthbert BN, Hyman SE, Lee FS, Ressler KJ. DSM-5 and RDoC: progress in psychiatry research? Nat Rev Neurosci. 2013;14:810–4.
Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–9.
Cannon TD, Cadenhead K, Cornblatt B, Woods SW, Addington J, Walker E, et al. Prediction of psychosis in youth at high clinical risk: a multisite longitudinal study in North America. Arch Gen Psychiatry. 2008;65:28–37.
Fusar-Poli P, Bonoldi I, Yung AR, Borgwardt S, Kempton MJ, Valmaggia L, et al. Predicting psychosis: meta-analysis of transition outcomes in individuals at high clinical risk. Arch Gen Psychiatry. 2012;69:220–9.
First M, Spitzer RL, Gibbon M, Williams B, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders, Patient. In: biometrics research department, New York state psychiatric institute. New York: New York; 1995.
Addington J, Cadenhead KS, Cornblatt BA, Mathalon DH, McGlashan TH, Perkins DO, et al. North American Prodrome longitudinal study (NAPLS 2): overview and recruitment. Schizophr Res. 2012;142:77–82.
Nouretdinov I, Costafreda SG, Gammerman A, Chervonenkis A, Vovk V, Vapnik V, et al. Machine learning classification with confidence: application of transductive conformal predictors to MRI-based diagnostic and prognostic markers in depression. Neuroimage. 2011;56:809–13.
Fu CH, Mourao-Miranda J, Costafreda SG, Khanna A, Marquand AF, Williams SC, et al. Pattern classification of sad facial processing: toward the development of neurobiological markers in depression. Biol Psychiatry. 2008;63:656–62.
Craddock RC, Holtzheimer PE III, Hu XP, Mayberg HS. Disease state prediction from resting state functional connectivity. Magn Reson Med. 2009;62:1619–28.
Gong Q, Wu Q, Scarpazza C, Lui S, Jia Z, Marquand A, et al. Prognostic prediction of therapeutic response in depression using high-field MR imaging. Neuroimage. 2011;55:1497–503.
Krakauer K, Ebdrup BH, Glenthoj BY, Raghava JM, Nordholm D, Randers L, et al. Patterns of white matter microstructure in individuals at ultra-high-risk for psychosis: associations to level of functioning and clinical symptoms. Psychol Med. 2017:1–19.
Vijayakumar N, Bartholomeusz C, Whitford T, Hermens DF, Nelson B, Rice S, et al. White matter integrity in individuals at ultra-high risk for psychosis: a systematic review and discussion of the role of polyunsaturated fatty acids. BMC Psychiatry. 2016;16:287.
Theberge J. Perfusion magnetic resonance imaging in psychiatry. Top Magn Reson Imaging. 2008;19:111–30.
Kuschinsky W. Coupling of function, metabolism, and blood flow in the brain. Neurosurg Rev. 1991;14:163–8.
Ho TC, Yang G, Wu J, Cassey P, Brown SD, Hoang N, et al. Functional connectivity of negative emotional processing in adolescent depression. J Affect Disord. 2014;155:65–74.
Ko M, Huang Y, Jankowska AM, Pape UJ, Tahiliani M, Bandukwala HS, et al. Impaired hydroxylation of 5-methylcytosine in myeloid cancers with mutant TET2. Nature. 2010;468:839–43.
Orbe J, Ferreira E, Nunez-Anton V. Comparing proportional hazards and accelerated failure time models for survival analysis. Stat Med. 2002;21:3493–510.
Royston P, Moons KG, Altman DG, Vergouwe Y. Prognosis and prognostic research: developing a prognostic model. BMJ. 2009;338:b604.
Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128–38.
Hemingway H, Croft P, Perel P, Hayden JA, Abrams K, Timmis A, et al. Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ. 2013;346:e5595.
Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S, et al. Prognosis research strategy (PROGRESS) 3: prognostic model research. PLoS Med. 2013;10:e1001381.
Collins GS, Altman DG. Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2. BMJ. 2012;344:e4181.
Anderson KM, Wilson PW, Odell PM, Kannel WB. An updated coronary risk profile. A statement for health professionals. Circulation. 1991;83:356–62.
Decarli A, Calza S, Masala G, Specchia C, Palli D, Gail MH. Gail model for prediction of absolute risk of invasive breast cancer: independent evaluation in the Florence-European prospective investigation into Cancer and nutrition cohort. J Natl Cancer Inst. 2006;98:1686–93.
Park Y, Freedman AN, Gail MH, Pee D, Hollenbeck A, Schatzkin A, et al. Validation of a colorectal cancer risk prediction model among white patients age 50 years and older. J Clin Oncol. 2009;27:694–8.
Cannon TD, Yu C, Addington J, Bearden CE, Cadenhead KS, Cornblatt BA et al.: An individualized risk calculator for research in prodromal psychosis. Am J Psychiatry 2016, appiajp201615070890.
Carrion RE, Cornblatt BA, Burton CZ, Tso IF, Auther AM, Adelsheim S, et al. Personalized prediction of psychosis: external validation of the NAPLS-2 psychosis risk calculator with the EDIPPP project. Am J Psychiatry. 2016;173:989–96.
Hafeman DM, Merranko J, Goldstein TR, Axelson D, Goldstein BI, Monk K, et al. Assessment of a person-level risk calculator to predict new-onset bipolar Spectrum disorder in youth at familial risk. JAMA Psychiatry. 2017;74:841–7.
Bernstein DP, Stein JA, Newcomb MD, Walker E, Pogge D, Ahluvalia T, et al. Development and validation of a brief screening version of the childhood trauma questionnaire. Child Abuse Negl. 2003;27:169–90.
Olson D. FACES IV and the Circumplex model: validation study. J Marital Fam Ther. 2011;37:64–80.
Cannon-Spoor H, Potkin S, Wyatt R. Measurement of premorbid adjustment in chronic schizophrenia. Schizophr Bull. 1982;8:470–84.
McCrae RR, Costa PT. NEO Inventories: Professional Manual. 2010. Lutz Florida, Psychol Assess ResourcesRef Type: Online Source.
Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, et al. The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008;165:203–13.
McGlashan T, Walsh BC, Woods SW. The Psychosis Risk Syndrome: Handbook for Diagnosis and Follow-up. New York. New York: Oxford University Press; 2010.
Addington D, Addington J, Maticka-Tyndale E. Assessing depression in schizophrenia: the Calgary depression scale. Br J Psychiatry. 1993;163:39–44.
Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–71.
Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168:1266–77.
Young RC, Biggs JT, Ziegler VE, Meyer DA. A rating scale for mania: reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–35.
Drake RE, Mueser K, McHugo G. Clinical rating scales. In: Sederer L, Dickey B, editors. Outcomes assessment in clinical practice. Baltimore: Williams and Wilkins; 1996. p. 113–6.
Arseneault L, Cannon M, Poulton R, Murray RM, Caspi A, Moffitt TE. Cannabis use in adolecence and risk for adult psychosis: longitudinal prospective study. Br Med J. 2002;325:1195–9.
Cornblatt BA, Auther AM, Niendam T, Smith CW, Zinberg J, Bearden CE, et al. Preliminary findings for two new measures of social and role functioning in the prodromal phase of schizophrenia. Schizophr Bull. 2007;33:688–702.
Olivares J, Garcia_Lopez LJ, Hidalgo MD. The social phobia scale and the social interaction anxiety scale: factor structure and reliability in a Spanish speaking population. J Psychoeduc Assess. 2001;19:69–80.
Addington J, Tran L. Using the brief core schema scales with individuals at clinical high risk of psychosis. Behav Cogn Psychother. 2009;37:227–31.
X.C.Liu, .Q.Liu, .Yang, .F Zhao reliability and validity of the adolescents self-rating life events checklist. Chin J Clin Psychol 1997, 5: 34–36.
Wilkinson PO, Goodyer IM. The effects of cognitive-behavioural therapy on mood-related ruminative response style in depressed adolescents. Child Adolesc Psychiatry Ment Health. 2008;2:3.
Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P. A scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale. Br J Psychiatry. 1995;167:99–103.
This project was funded by the Brain Canada Foundation and the Mathison Centre for Research & Education at the University of Calgary. The opinions, results and conclusions are those of the authors and no endorsement by either funding source is intended or should be inferred.
Availability of data and materials
JA and GMM made substantial contributions to overall study conception and design. SB, CL and SH contributed to the design of the neuroimaging component, JLW to the development of the prediction models and data analysis. BLG was responsible for setting up and overseeing the study at the Sunnybrook site, SK for the design of the peripheral biomarker component and CM for contributing to rater training and managing the study at the Calgary site. JA drafted the manuscript. All authors were involved in critical revisions of the manuscript. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Research described in this article has been approved by the ethics board at each participating clinical centre. The ethics committees include: University of Calgary Conjoint Health Research Ethics Board (Calgary) and Sunnybrook Research Ethics Board (Toronto). All participants provided written, informed consent for all study procedures.
Consent for publication
This is not applicable, as this manuscript does not contain any individual persons’ data.
JA has received research support from National Institute of Mental Health, Brain Canada and the Mathison Centre at the University of Calgary. SHK has received funding or honoraria from the following sources: Abbott, Allergan, AstraZeneca, BMS, Brain Cells Inc., Brain Canada, Clera, CIHR, Eli Lilly, Janssen, Lundbeck, Lundbeck Institute, OMHF, Ontario Brain Institute, Otsuka, Pfizer, Servier, St. Jude Medical, Sunovion and Xian-Janssen. GM has been on advisory board or speaker for Allergen, Lundbeck, Lilly, Pfizer, Janssen. BG, JW, SB, CL, SH, and CM list no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Addington, J., Goldstein, B.I., Wang, J.L. et al. Youth at-risk for serious mental illness: methods of the PROCAN study. BMC Psychiatry 18, 219 (2018). https://doi.org/10.1186/s12888-018-1801-0
- Bipolar disorder
- Clinical high risk