Skip to main content

Severity in sustained attention impairment and clozapine-resistant schizophrenia: a retrospective study



Among patients with treatment-resistant schizophrenia (TRS), some exhibited further clozapine resistance (CR). This study aimed to investigate whether greater severity of treatment resistance in schizophrenia is associated with greater impairments in sustained attention.


Patients with a DSM-IV-defined schizophrenia were recruited from a psychiatric center in northern Taiwan (April 2010 to October 2010). Both TRS and CR were determined retrospectively from participants’ medical records following the consensus guidelines. The patients were divided into three groups: 102 non-TRS, 48 TRS without CR, and 54 TRS with CR. They underwent both undegraded and degraded Continuous Performance Tests (CPT), and their performance scores (d′) were standardized against a community sample to derive age-, sex-, and education-adjusted z scores.


The TRS with CR group had significantly lower adjusted z scores of d′ on both undegraded and degraded CPTs than the other two groups. Meanwhile, the differences between the TRS without CR group and the non-TRS group were not significant. Multivariable linear regression analyses with adjustment for covariates revealed a trend of gradient impairments on the degraded CPT from non-TRS to TRS without CR and to TRS with CR. The proportions of attentional deficits (an adjusted z score of ≤ − 2.5) on the degraded CPT also exhibited a significant trend, from 36.3% in the non-TRS group to 62.5% in the TRS without CR group and to 83.3% in the TRS with CR group.


Greater severity of treatment resistance in schizophrenia was associated with greater impairments in sustained attention, indicating some common vulnerability.

Peer Review reports


Despite extensive progress in the treatment of schizophrenia, approximately 30% of patients of schizophrenia show poor responses to treatment, denoted as treatment-resistant schizophrenia (TRS) [1, 2]. After the initial description of TRS [3], the definition of TRS has evolved over the decades and has converged on well-defined criteria, including response failure to two antipsychotics and persistence of illness despite adequate treatment [1, 4, 5]. Clozapine has remained the gold standard treatment of TRS since its efficacy was described in a randomized trial [6]. However, an estimated 30% of patients receiving clozapine have unsatisfactory responses and are known to have ultra-treatment-resistant schizophrenia [7], super-refractory schizophrenia [8], or clozapine-resistant schizophrenia [5].

Neurodevelopmental pathological processes have been considered to contribute to the etiology of schizophrenia [9,10,11,12], and may play a role in the development of TRS [13]. A great deal of research has profiled that TRS has neurochemical and structural abnormalities different from non-TRS or treatment-responsive schizophrenia [8, 14,15,16,17,18]. Hence, TRS might be associated with markers of neurodevelopment. For example, TRS patients have been reported to have certain minor physical anomalies and craniofacial features [19] and more neurological soft signs [20]. Furthermore, part of TRS patients may further encounter clozapine resistance (CR), and it has been suggested that TRS patients with CR might have underlying pathophysiologies that are different from those of TRS patients without CR [16, 17].

A growing body of research indicates that cognitive dysfunction, a core feature of schizophrenia detectable before the onset of full-blown psychosis [21], not only predicts the functional outcomes [22], but also serves as an endophenotype, which is quantitatively measured pathophysiological impairment suggesting genetic susceptibilities to schizophrenia [23]. Among those cognitive dysfunctions, impairments in sustained attention, as measured by the Continuous Performance Test (CPT) [24], are one of the key cognitive domains [25], and also an endophenotype leading to better linkage signals in schizophrenia [26]. CPT impairments are present in patients with schizophrenia across different illness stages [27, 28], not remedied by neuroleptics [29, 30], present in non-psychotic relatives, and have heritability in healthy populations and schizophrenia families [26, 29]. Comparing different cognitive dysfunctions associated with schizophrenia, the magnitude of familial aggregation of CPT impairments is greater than that of executive function impairments measured by Wisconsin Card Sorting Test [26, 31, 32]. Hence, greater CPT impairments may imply more genetic susceptibility to schizophrenia [26], in line with the neurodevelopmental model of schizophrenia [21].

Taken together, aberrant neurodevelopment may underlie both the sustained attention impairments and the development of treatment resistance. Hence, greater attentional impairments might be associated with more severe treatment resistance in schizophrenia. An earlier review found little evidence that patients with TRS had more severe cognitive impairments than patients with non-TRS [33]. However, more recent studies did demonstrate that patients with TRS performed worse on some cognitive domains, e.g., verbal memory [34], attention, cognitive flexibility, processing speed, executive functions, and verbal fluency [35]. Of note, one study comparing TRS patients responsive to clozapine versus TRS patients resistant to clozapine failed to find differences using a battery of neuropsychological tests, including sustained attention, probably due to the small sample sizes and relatively inadequate persistence of the illness [7]. Overall, the literature implies that schizophrenia patients with gradient treatment resistance may have different etio-pathophysiologies, whereas there remains a lack of empirical support from studies that have sufficient sample size and different levels of treatment resistance.

To address the gap in the literature, we sought to examine the severity of sustained attention deficit and the magnitude of treatment resistance in a case-control approach. The aims of the study were to investigate whether greater impairments on the CPT were associated with more treatment resistance in schizophrenia. We conducted two CPT sessions among patients with TRS versus age- and sex-matched patients without TRS and further divided TRS patients into two groups based on the presence of CR or not. We hypothesized that TRS patients with CR would have the greatest CPT impairments, non-TRS patients would have the smallest CPT impairments, and the TRS patients without CR would have moderate CPT impairments.



This study was part of a larger study investigating TRS conducted in the Bali Psychiatric Center in northern Taiwan from April 2010 to October 2010. The procedure of enrollment has been described in detail in our previous study [19]. Briefly, we examined the medical charts during the study period to recruit patients with schizophrenia according to the DSM-IV criteria and then determined whether the patients had treatment resistance. The study was approved by the Institutional Review Board of the Bali Psychiatric Center (IRB990309–01). We obtained written informed consent from all the participants after providing a complete description of the study. Each subject’s identifier was removed and replaced by a code.

In this study, treatment resistance was defined by the following criteria: 1) a drug-refractory condition; and 2) persistence of illness, which were adapted from the guidelines proposed by Conley and Kelly [4]. Patients who failed to respond to at least two trials of antipsychotics, each for at least 6 weeks and administered at “adequate dosages”, were determined to have a drug-refractory condition. Response failure was determined as worse than or equal to “minimal improvement” in terms of the overall change after switching to a drug on the global improvement subscale of the Clinical Global Impression scale (CGI-I) [36], i.e., CGI-I ≥ 3. The “adequate dosages” were greater than or equal to 600 mg/day of chlorpromazine equivalents (CPZEs) for typical antipsychotics or at adequate dosages based on an expert consensus panel for atypical antipsychotics [37]. Persistence of illness was defined as more than or equal to “moderately ill” on the severity of illness subscale of the Clinical Global Impression scale (CGI-S), i.e., CGI-S ≥ 4. Patients who did not fulfill any of these two criteria were classified as non-TRS, while patients who fulfilled only one criterion were excluded because of grouping controversy.

Moreover, we reappraised the study participants and further divided the TRS patients into two groups based on the presence of CR or not, adapted from the consensus criteria of the Treatment Response and Resistance in Psychosis (TRRIP) working group [5]. Among TRS patients, those who exhibited response failure (i.e., CGI-I ≥ 3) to clozapine at a stable dosage for at least 3 months were thus classified as TRS with CR. Those who had not used clozapine (clozapine never-user) or were rated as better than “minimally improvement” on the CGI-I subscale (i.e., CGI-I < 3) in response to clozapine (clozapine responder) were classified as TRS without CR. Those who had poor responses to clozapine with inadequate durations (i.e., less than 3 months) were excluded from this study.

We further excluded patients if they exhibited the following: 1) a concurrent diagnosis of at least one other major Axis I psychiatric illness (e.g., schizoaffective disorder or substance-induced psychotic disorder); 2) mental retardation; or 3) a parent who was not Han Chinese (e.g., aboriginals or foreigners).

Among the 212 patients included in our previous study (104 non-TRS and 108 TRS) [19], eight patients were excluded, with five due to missing information regarding the CPT and three due to inadequate durations of clozapine trials for grouping. In the final sample of 204 patients, 102 were classified as TRS, who were further divided into TRS without CR (n = 48) and TRS with CR (n = 54). The remaining 102 patients were classified as non-TRS, who were selected by frequency matching using the distributions of sex and 10-year age groups of the TRS cases.

Review of medical records

A board-certified psychiatrist (A.-S.L.) performed a systemic review of medical charts to collect clinical information, to rate the CGI scales retrospectively and to determine the group assignments. Considering the medication adherence, only the medication records during hospitalization were used to determine the drug-refractory condition. The group assignment of TRS status for each patient was reconfirmed by the primary care psychiatrist. Only one patient was noted to have TRS assignment incongruent with the determination of the primary care psychiatrist, and was excluded from the study.

Continuous Performance Test

A computerized version of the CPT that was validated to the procedure of a CPT machine from Sunrise System, version 2.20 (Pembroke, MA, USA), was used to assess sustained attention. The procedure was described in detail elsewhere [38]. In short, numbers from 0 to 9 were randomly presented for 50 milliseconds each, at a rate of one per second. Participants were asked to respond to the target stimulus (the number “9” preceded by the number “1”) by pressing a button. Each participant underwent two CPT sessions: 1) the undegraded 1–9 task; and the 2) 25% degraded 1–9 task. A total of 331 trials, 34 of which were target stimuli, were presented over 5 min for each session. During the 25% degraded session, a pattern of snow was used to make the image less distinct. The sensitivity index of CPT performance (d′) was derived from the hit rate (probability of response to target trials) and the false-alarm rate (probability of response to non-target trials), reflecting an individual’s ability to discriminate target stimuli from non-target stimuli [39, 40].

Furthermore, the d′ was standardized against 345 community controls, with adjustments for age, gender, and education, expressed as adjusted z scores of d′ [41]. We defined a sustained attention deficit by an adjusted z score of less than or equal to − 2.5, as described in a previous family-genetic study [42].

Statistical analyses

All statistical analyses were performed using the SAS statistical software, version 9.4 (SAS Institute, Cary, NC). For categorical variables, χ2 tests or Fisher’s exact tests were used for group comparisons, and a Tukey-type multiple comparison for proportions [43] or multiple comparisons with Fisher’s combination test were used for the relevant post hoc analyses. For continuous variables, t-tests were used in 2 group comparisons, and ANOVA/ANCOVA were used in 3 group comparisons, with Tukey’s HSD tests and Tukey-Kramer adjustments for the post hoc pairwise comparisons. To examine the relations between the adjusted z scores of d′ and the treatment resistance group, which were denoted by dummy variables, we used linear regression analysis with adjustment for covariates.


The three groups of participants, i.e., non-TRS (n = 102), TRS without CR (n = 48), and TRS with CR (n = 54), were comparable in terms of the distributions of age, sex, educational years, family history of schizophrenia, and current alcohol use status (Table 1). However, there were significant differences among the three groups in terms of the distributions of age of onset, early onset (age of onset younger than 18 years), duration of illness, number of hospitalizations, ratings on the CGI-S, and current cigarette-smoking status. When compared to the non-TRS group, both the TRS without CR group and the TRS with CR group had earlier mean ages of onset, greater proportions of early onset, longer mean durations of illness, greater mean numbers of hospitalizations, and greater mean ratings on the CGI-S. However, there were no significant differences between the two TRS subgroups in terms of these variables.

Table 1 Demographic and clinical characteristics of the study participants

Table 2 shows that the three groups had remarkably different profiles in terms of residential dispositions and clozapine usage, with the two TRS subgroups having higher proportions of chronic ward inpatients and clozapine usage than the non-TRS group. The mean dosages of clozapine were not significantly different between the two TRS subgroups. The non-TRS group had lower mean antipsychotic dosages of CPZEs and lower proportions of polypharmacy (more than one antipsychotic) and atypical-antipsychotic use (the CPZEs of atypical antipsychotics more than that of conventional antipsychotics) than the two TRS subgroups, while there were no significant differences between the two TRS subgroups.

Table 2 Current dispositions and medications of the study participants

Then, the adjusted z scores of CPT d′ among the three groups were compared using ANCOVA with adjustments for illness duration, number of hospitalizations, CGI-S ratings, presence of early onset, smoking status, current antipsychotic dosage, and atypical-antipsychotic use (Table 3). The covariates were selected from the demographic, clinical, and medication variables with group differences, and for covariates that had a pairwise Pearson correlation coefficient of more than or equal to 0.5, we retained the ones with more clinical relevance (Additional file 1: Table S1). We did not adjust for age, sex, or educational years, which were already controlled for in the standardization process; neither did we adjust for current disposition or clozapine usage, which were highly correlated with the determination of treatment resistance status. Regarding the undegraded CPT, the TRS with CR group had significantly lower adjusted z scores of d′ than the other two groups, whereas the TRS without CR group and the non-TRS group exhibited no significant differences for adjusted z scores. Regarding the proportion of sustained attention deficits, it was the highest in the TRS with CR group (81.5%), followed by the TRS without CR group (56.3%), and then the non-TRS group (37.3%). Similarly for the degraded CPT, the TRS with CR group had significantly lower adjusted z scores of d′ than the other two groups, whereas the TRS without CR group and the non-TRS group did not differ significantly in terms of this variable. In terms of the proportion of sustained attention deficits on the degraded CPT, the post hoc comparisons did reach statistical significance, with the highest one in the TRS with CR group (83.3%), followed by that in the TRS without CR group (62.5%), and then that in the non-TRS group (36.3%).

Table 3 Adjusted z scores of d′ on the Continuous Performance Test (CPT) among the study participants with group comparisons

To further estimate the relations between CPT performance and the severity of treatment resistance, we conducted multivariable linear regression analyses of the adjusted z scores of d′ for group status, with adjustments for the demographic and clinical features (Table 4). For the undegraded CPT, both the TRS without CR group and the TRS with CR group had lower mean adjusted z scores of d′ than the non-TRS group, with the regression coefficients being − 0.76 and − 2.25, respectively (only the latter statistically significant). Likewise, for the degraded CPT, both the TRS without CR group and the TRS with CR group had lower mean adjusted z scores of d′ than the non-TRS group, with the regression coefficients being − 0.71 and − 1.53, respectively (both statistically significant).

Table 4 Linear regression analysis of the adjusted z scores of d′ on the Continuous Performance Test (CPT) in terms of treatment-resistant status with adjustments for covariates

Since the TRS without CR group consisted of 17 clozapine never-users and 31 clozapine responders, the two subgroups were further examined. We found that the two subgroups had no significant differences in terms of their demographic and clinical characteristics (Additional file 1: Table S2) or in terms of current disposition and polypharmacy (Additional file 1: Table S3), except for the experience of clozapine usage. Comparing their CPT performances, the clozapine responders had higher scores on the undegraded CPT than the clozapine never-users did, whereas their performances did not differ on the degraded CPT (Additional file 1: Table S4).


This work is one of the few studies that have examined the sustained attention impairments among TRS patients by further grouping them into TRS without CR and TRS with CR. Our results revealed a gradient impairment in sustained attention from non-TRS to TRS without CR and to TRS with CR, regardless of continuous CPT performance scores or the proportion of binary CPT deficits (an adjusted z score of ≤ − 2.5). These findings helped shed light on the relations between sustained attention impairments and the severity of treatment resistance in patients with schizophrenia.

In this study, we demonstrated that the two TRS subgroups were distinct from the non-TRS group, in that they had earlier mean ages of onset, longer durations of illness, and a greater number of hospitalizations, which were compatible with the findings from a previous review [8]. Additionally, two variables were worthy of further discussion. First, compared to the non-TRS group, the TRS with CR group, whom were almost exclusively recruited from chronic wards, had a lower proportion of current habitual tobacco smokers, which was mostly attributed to the tight regulation of tobacco use in chronic wards. Nevertheless, we included smoking status as a covariate to adjust for the potential influences of tobacco smoking on the cognitive performances among patients with schizophrenia [44, 45]. Second, the clozapine dosages were not as high as those observed in other studies [7] possibly because 400 mg/day was the recommended maximum dosage according to the prescription guidelines issued by National Health Insurance Administration in Taiwan.

Our findings revealed that the attentional impairments among TRS patients could be further characterized by the presence of CR, which leads to the most severe impairments. There have been few studies examining attentional impairments within the subgroup of TRS patients. A previous study examining selective attention, as measured by the Stroop test, found TRS patients to have poorer performance than non-TRS patients [35], a finding that was similar to ours, but the study did not further divide its TRS patients according to CR. Another study that did divide their TRS patients further according to CR failed to find any significant differences in a battery of neuropsychological tests covering multiple cognitive domains among three groups of schizophrenia patients, namely, TRS with CR, TRS with clozapine responsiveness, and non-TRS with responsiveness to first-line antipsychotics [7]. Its results were possibly limited by the relatively small sample sizes in each group (15, 20, and 16, respectively) and by a special request from their two groups of TRS patients, which required an adequate response at recruitment either to clozapine monotherapy or combined antipsychotics.

It is noteworthy that we conducted two sessions of the CPT, with the 25% degraded CPT adding a perceptual load to the task and providing one more dimension for detecting schizophrenia vulnerability [46,47,48]. There have been various versions of CPT for measuring sustained attention. Besides the two versions used in this study, CPT versions with successive identical pairs of 2–4 digits or shapes (CPT-IP), which add working memory loads [47, 49, 50], have been used widely and adopted in a consensus cognitive battery for multi-site clinical trials of cognition treatment in schizophrenia [25]. A review by the Consortium on the Genetics of Schizophrenia summarized that CPTs with high perceptual or working-memory loads successfully detect neurocognitive deficits among biological relatives of schizophrenia patients, while CPTs with low perceptual or working-memory loads fail to detect such deficits [29]. This may explain our finding that the three groups of patients, i.e., non-TRS, TRS without CR, and TRS with CR, showed a clear trend in both continuous CPT performance scores and binary CPT deficit only on the degraded CPT, whereas on the undegraded CPT, the groups of non-TRS and TRS without CR could not be distinguished with statistical significance.

In this study we standardized the CPT performance against a community healthy control sample with adjustment for age, sex, and education to derive adjusted z scores. Using the same community norm, a previous trajectory analysis of repeated CPT measurements during a follow-up period of 4 to 7 years revealed that patients with severe impairments at baseline, i.e., a mean adjusted z score of < − 2.5, had a trajectory pattern of persistent deficit through follow-ups [51]. Intriguingly, attention/vigilance has been considered a separable factor from other cognitive domains [52], a distinct factor from other endophenotypes [53], and hence a useful indicator for illness development, particularly for a disorder with neurodevelopmental dysfunction [21]. Our findings supported the postulation that more severe treatment resistance (i.e., CR) is associated with greater impairments in sustained attention, hence more genetic susceptibility to schizophrenia. A recent genome-wide association study found that clozapine non-responders indeed had higher polygenic risk scores than clozapine responders [54], echoing our results.

In addition, the TRS without CR group tended to have CPT impairments that fell in-between that of the non-TRS group and the TRS with CR group, although the differences between the non-TRS group and the TRS without CR group reached statistical significance only for the binary deficit on the degraded CPT. One explanation is that the degraded CPT, the more difficult version, has been shown to be more sensitive than the undegraded version in showing the non-amenability of sustained attention deficit to short-term antipsychotic treatment [30, 55] and detecting the attention-related genetic susceptibility to schizophrenia [29, 31, 42, 48]. Furthermore, the TRS without CR group included a subgroup of patients who had not yet tried clozapine, who tended to show poorer CPT performances than clozapine responders, though this difference did not reach statistical significance even on the degraded CPT. Given the small sample size of this subgroup of clozapine never-users, future studies are warranted to examine whether clozapine responders are indeed distinguishable from clozapine never-users.


Our findings imply that patients with severe deficits in sustained attention may need early intervention with clozapine. Clozapine has remained the treatment of choice for patients with TRS. To initiate clozapine treatment, current practice guidelines recommend a step-by-step course that may be time-consuming. In addition, a variety of side effects may render clinicians hesitant to initiating clozapine. Using the CPT impairment in terms of adjusted z score as an indicator, we may be able to identify schizophrenia patients with attentional deficits of sufficient severity in the early phase of treatment course that warrants initiating clozapine.


This study had several additional limitations. First, sustained attention is only one aspect of the neurocognitive impairments associated with schizophrenia, although it has been widely used and relatively easy to measure. Using a battery covering several key elements of cognitive domains may provide more comprehensive information. Second, this study used the CGI-I to rate symptom changes and the CGI-S to rate severity at recruitment retrospectively. Using a more comprehensive scale, such as the PANSS [56] or the BPRS [57], in a prospective manner may provide better assessments in future studies. Third, we determined the adequate dosages of antipsychotics, including clozapine, based on chart records rather than on blood drug levels. Nevertheless, as suggested in recent guidelines [5], our retrospective assessments were based only on the medication records during hospitalization to assure patients’ adherence to treatment. Fourth, we treated sustained attention deficit as a state-independent endophenotype in this study and only used the CPZEs of current antipsychotic agents as a covariate of ANCOVA in the group comparisons to control for potential confounding by medications. However, some studies found that antipsychotics might attenuate the severity of attentional deficits [29], which was also found in a trajectory analysis that one trajectory class who had moderate CPT impairments of adjusted z score between − 1.0 and − 2.5 did exhibit improvement in CPT performance during the follow-up of 4 to 7 years [51]. These highlight the importance of CPT impairment severity in distinguishing TRS with CR from TRS without CR. Fifth, anticholinergic agents might be associated with memory impairment [58], but information about such treatment was not collected in this study. Finally, we used non-TRS patients rather than treatment-responsive patients as the comparison group. A recent review suggested that using a well-defined treatment-responsive group as the comparison group may offer a better understanding of the origin of treatment resistance [18].


In summary, our findings suggested that there is a trend of greater impairments in sustained attention associated with greater severity of treatment resistance in schizophrenia, adding support to the postulation that both might share some common vulnerability. In particular, TRS with CR could be viewed as a more homogenous subtype with the greatest impairment in sustained attention, and future research on this subgroup of TRS is warranted to explore the mechanisms underlying treatment resistance in schizophrenia.

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available due to ethical concerns but are available from the corresponding author on reasonable request.



Clinical Global Impression scale, the global improvement subscale


Clinical Global Impression scale, the severity of illness subscale


Continuous Performance Tests


Identical Paris Continuous Performance Tests


chlorpromazine equivalents


clozapine resistance


treatment-resistant schizophrenia


  1. Lehman AF, Lieberman JA, Dixon LB, McGlashan TH, Miller AL, Perkins DO, Kreyenbuhl J, American Psychiatric Association Steering Committee on Practice Guidelines. Practice guideline for the treatment of patients with schizophrenia, second edition. Am J Psychiatry. 2004;161:1–56.

  2. Elkis H. Treatment-resistant schizophrenia. Psychiatr Clin North Am. 2007;30:511–33.

    Article  Google Scholar 

  3. Itil TM, Keskiner A, Fink M. Therapeutic studies in "therapy resistant" schizophrenic patients. Compr Psychiatry. 1966;7:488–93.

    Article  CAS  Google Scholar 

  4. Conley RR, Kelly DL. Management of treatment resistance in schizophrenia. Biol Psychiatry. 2001;50:898–911.

    Article  CAS  Google Scholar 

  5. Howes OD, McCutcheon R, Agid O, de Bartolomeis A, van Beveren NJ, Birnbaum ML, Bloomfield MA, Bressan RA, Buchanan RW, Carpenter WT, et al. Treatment-resistant schizophrenia: treatment response and resistance in psychosis (TRRIP) working group consensus guidelines on diagnosis and terminology. Am J Psychiatry. 2017;174:216–29.

    Article  Google Scholar 

  6. Kane J, Honigfeld G, Singer J, Meltzer H. Clozapine for the treatment-resistant schizophrenic. A double-blind comparison with chlorpromazine. Arch Gen Psychiatry. 1988;45:789–96.

    Article  CAS  Google Scholar 

  7. Anderson VM, McIlwain ME, Kydd RR, Russell BR. Does cognitive impairment in treatment-resistant and ultra-treatment-resistant schizophrenia differ from that in treatment responders? Psychiatry Res. 2015;230:811–8.

    Article  Google Scholar 

  8. Elkis H, Buckley PF. Treatment-resistant schizophrenia. Psychiatr Clin North Am. 2016;39:239–65.

    Article  Google Scholar 

  9. Weinberger DR. Implications of normal brain development for the pathogenesis of schizophrenia. Arch Gen Psychiatry. 1987;44:660–9.

    Article  CAS  Google Scholar 

  10. Murray RM, O'Callaghan E, Castle DJ, Lewis SW. A neurodevelopmental approach to the classification of schizophrenia. Schizophr Bull. 1992;18:319–32.

    Article  CAS  Google Scholar 

  11. Fatemi SH, Folsom TD. The neurodevelopmental hypothesis of schizophrenia, revisited. Schizophr Bull. 2009;35:528–48.

    Article  Google Scholar 

  12. Rapoport JL, Giedd JN, Gogtay N. Neurodevelopmental model of schizophrenia: update 2012. Mol Psychiatry. 2012;17:1228–38.

    Article  CAS  Google Scholar 

  13. Sheitman BB, Lieberman JA. The natural history and pathophysiology of treatment resistant schizophrenia. J Psychiatr Res. 1998;32:143–50.

    Article  CAS  Google Scholar 

  14. Demjaha A, Murray RM, McGuire PK, Kapur S, Howes OD. Dopamine synthesis capacity in patients with treatment-resistant schizophrenia. Am J Psychiatry. 2012;169:1203–10.

    Article  Google Scholar 

  15. Demjaha A, Egerton A, Murray RM, Kapur S, Howes OD, Stone JM, McGuire PK. Antipsychotic treatment resistance in schizophrenia associated with elevated glutamate levels but normal dopamine function. Biol Psychiatry. 2014;75:e11–3.

    Article  CAS  Google Scholar 

  16. Goldstein ME, Anderson VM, Pillai A, Kydd RR, Russell BR. Glutamatergic neurometabolites in clozapine-responsive and -resistant schizophrenia. Int J Neuropsychopharmacol. 2015;18.

    Article  Google Scholar 

  17. Anderson VM, Goldstein ME, Kydd RR, Russell BR. Extensive gray matter volume reduction in treatment-resistant schizophrenia. Int J Neuropsychopharmacol. 2015;18:pyv016.

    Article  Google Scholar 

  18. Gillespie AL, Samanaite R, Mill J, Egerton A, MacCabe JH. Is treatment-resistant schizophrenia categorically distinct from treatment-responsive schizophrenia? A systematic review. BMC Psychiatry. 2017;17:12.

    Article  Google Scholar 

  19. Lin AS, Chang SS, Lin SH, Peng YC, Hwu HG, Chen WJ. Minor physical anomalies and craniofacial measures in patients with treatment-resistant schizophrenia. Psychol Med. 2015;45:1839–50.

    Article  Google Scholar 

  20. de Bartolomeis A, Prinzivalli E, Callovini G, D'Ambrosio L, Altavilla B, Avagliano C, Iasevoli F. Treatment resistant schizophrenia and neurological soft signs may converge on the same pathology: evidence from explanatory analysis on clinical, psychopathological, and cognitive variables. Prog Neuro-Psychopharmacol Biol Psychiatry. 2018;81:356–66.

    Article  Google Scholar 

  21. Seidman LJ, Mirsky AF. Evolving notions of schizophrenia as a developmental neurocognitive disorder. J Int Neuropsychol Soc. 2017;23:881–92.

    Article  Google Scholar 

  22. Green MF. Impact of cognitive and social cognitive impairment on functional outcomes in patients with schizophrenia. J Clin Psychiatry. 2016;77(Suppl 2):8–11.

    Article  Google Scholar 

  23. Gottesman II, Gould TD. The endophenotype concept in psychiatry: etymology and strategic intentions. Am J Psychiatry. 2003;160:636–45.

    Article  Google Scholar 

  24. Beck LH, Bransome ED Jr, Mirsky AF, Rosvold HE, Sarason I. A continuous performance test of brain damage. J Consult Psychol. 1956;20:343–50.

    Article  CAS  Google Scholar 

  25. Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, Essock S, Fenton WS, Frese FJ 3rd, Gold JM, et al. The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008;165:203–13.

    Article  Google Scholar 

  26. Chen WJ. Taiwan schizophrenia linkage study: lessons learned from endophenotype-based genome-wide linkage scans and perspective. Am J Med Genet B Neuropsychiatr Genet. 2013;162B:636–47.

    Article  Google Scholar 

  27. Asarnow RF, MacCrimmon DJ. Span of apprehension deficits during the postpsychotic stages of schizophrenia. A replication and extension. Arch Gen Psychiatry. 1981;38:1006–11.

    Article  CAS  Google Scholar 

  28. Nuechterlein KH, Dawson ME. Information processing and attentional functioning in the developmental course of schizophrenic disorders. Schizophr Bull. 1984;10:160–203.

    Article  CAS  Google Scholar 

  29. Gur RE, Calkins ME, Gur RC, Horan WP, Nuechterlein KH, Seidman LJ, Stone WS. The consortium on the genetics of schizophrenia: neurocognitive endophenotypes. Schizophr Bull. 2007;33:49–68.

    Article  Google Scholar 

  30. Liu SK, Chen WJ, Chang CJ, Lin HN. Effects of atypical neuroleptics on sustained attention deficits in schizophrenia: a trial of risperidone versus haloperidol. Neuropsychopharmacology. 2000;22:311–9.

    Article  CAS  Google Scholar 

  31. Tsuang HC, Lin SH, Liu SK, Hsieh MH, Hwang TJ, Liu CM, Hwu HG, Chen WJ. More severe sustained attention deficits in nonpsychotic siblings of multiplex schizophrenia families than in those of simplex ones. Schizophr Res. 2006;87:172–80.

    Article  Google Scholar 

  32. Lin SH, Liu CM, Hwang TJ, Hsieh MH, Hsiao PC, Faraone SV, Tsuang MT, Hwu HG, Chen WJ. Performance on the Wisconsin card sorting test in families of schizophrenia patients with different familial loadings. Schizophr Bull. 2013;39:537–46.

    Article  Google Scholar 

  33. Woodward N, Meltzer H. Neuropsychology of treatment-resistant schizophrenia. In: Elkis H, Meltzer H, editors. Therapy-resistant schizophrenia, vol. 26. Basel (Switzerland): Karger; 2010. p. 33–51.

    Chapter  Google Scholar 

  34. de Bartolomeis A, Balletta R, Giordano S, Buonaguro EF, Latte G, Iasevoli F. Differential cognitive performances between schizophrenic responders and non-responders to antipsychotics: correlation with course of the illness, psychopathology, attitude to the treatment and antipsychotics doses. Psychiatry Res. 2013;210:387–95.

    Article  Google Scholar 

  35. Frydecka D, Beszlej JA, Goscimski P, Kiejna A, Misiak B. Profiling cognitive impairment in treatment-resistant schizophrenia patients. Psychiatry Res. 2016;235:133–8.

    Article  Google Scholar 

  36. Guy W. ECDEU Assessment Manual for Psychopharmacology. Rockville, Md.: U.S. Dept. of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration, National Institute of Mental Health, Psychopharmacology Research Branch, Division of Extramural Research Programs; 1976.

  37. Kane JM, Leucht S, Carpenter D, Docherty JP. The expert consensus guideline series. Optimizing pharmacologic treatment of psychotic disorders. Introduction: methods, commentary, and summary. J Clin Psychiatry. 2003;64:5–19.

    Article  Google Scholar 

  38. Chen WJ, Hsiao CK, Hsiao LL, Hwu HG. Performance of the continuous performance test among community samples. Schizophr Bull. 1998;24:163–74.

    Article  CAS  Google Scholar 

  39. Swets JA. The relative operating characteristic in psychology: a technique for isolating effects of response bias finds wide use in the study of perception and cognition. Science. 1973;182:990–1000.

    Article  CAS  Google Scholar 

  40. Nuechterlein KH. Vigilance in schizophrenia and related disorders. In: Steinhauer SR, Gruzelier JH, Zubin J, editors. Handbook of schizophrenia: neuropsychology, psychophysiology, and information processing, vol. 5. Amsterdam: Elsevier Science; 1991. p. 397–433.

    Google Scholar 

  41. Chen WJ, Liu SK, Chang CJ, Lien YJ, Chang YH, Hwu HG. Sustained attention deficit and schizotypal personality features in nonpsychotic relatives of schizophrenic patients. Am J Psychiatry. 1998;155:1214–20.

    Article  CAS  Google Scholar 

  42. Chen WJ, Chang CH, Liu SK, Hwang TJ, Hwu HG. Sustained attention deficits in nonpsychotic relatives of schizophrenic patients: a recurrence risk ratio analysis. Biol Psychiatry. 2004;55:995–1000.

    Article  Google Scholar 

  43. Elliott AC, Reisch JS. Implementing a multiple comparison test for proportions in a 2xc crosstabulation in SAS®. Proceedings of the SAS User's Group International. 2006;31:204–31.

    Google Scholar 

  44. Iasevoli F, Balletta R, Gilardi V, Giordano S, de Bartolomeis A. Tobacco smoking in treatment-resistant schizophrenia patients is associated with impaired cognitive functioning, more severe negative symptoms, and poorer social adjustment. Neuropsychiatr Dis Treat. 2013;9:1113–20.

    Article  Google Scholar 

  45. Mackowick KM, Barr MS, Wing VC, Rabin RA, Ouellet-Plamondon C, George TP. Neurocognitive endophenotypes in schizophrenia: modulation by nicotinic receptor systems. Prog Neuro-Psychopharmacol Biol Psychiatry. 2014;52:79–85.

    Article  CAS  Google Scholar 

  46. Nuechterlein KH, Parasuraman R, Jiang Q. Visual sustained attention: image degradation produces rapid sensitivity decrement over time. Science. 1983;220:327–9.

    Article  CAS  Google Scholar 

  47. Cornblatt BA, Lenzenweger MF, Erlenmeyer-Kimling L. The continuous performance test, identical pairs version: II. Contrasting attentional profiles in schizophrenic and depressed patients. Psychiatry Res. 1989;29:65–85.

    Article  CAS  Google Scholar 

  48. Nuechterlein KH, Green MF, Calkins ME, Greenwood TA, Gur RE, Gur RC, Lazzeroni LC, Light GA, Radant AD, Seidman LJ, et al. Attention/vigilance in schizophrenia: performance results from a large multi-site study of the consortium on the genetics of schizophrenia (COGS). Schizophr Res. 2015;163:38–46.

    Article  Google Scholar 

  49. Cornblatt BA, Risch NJ, Faris G, Friedman D, Erlenmeyer-Kimling L. The continuous performance test, identical pairs version (CPT-IP): I. new findings about sustained attention in normal families. Psychiatry Res. 1988;26:223–38.

    Article  CAS  Google Scholar 

  50. Kahn PV, Walker TM, Williams TS, Cornblatt BA, Mohs RC, Keefe RS. Standardizing the use of the continuous performance test in schizophrenia research: a validation study. Schizophr Res. 2012;142:153–8.

    Article  Google Scholar 

  51. Liu SK, Hsieh MH, Hwang TJ, Hwu HG, Liao SC, Lin SH, Chen WJ. Re-examining sustained attention deficits as vulnerability indicators for schizophrenia: stability in the long term course. J Psychiatr Res. 2006;40:613–21.

    Article  Google Scholar 

  52. Nuechterlein KH, Barch DM, Gold JM, Goldberg TE, Green MF, Heaton RK. Identification of separable cognitive factors in schizophrenia. Schizophr Res. 2004;72:29–39.

    Article  Google Scholar 

  53. Seidman LJ, Hellemann G, Nuechterlein KH, Greenwood TA, Braff DL, Cadenhead KS, Calkins ME, Freedman R, Gur RE, Gur RC, et al. Factor structure and heritability of endophenotypes in schizophrenia: findings from the consortium on the genetics of schizophrenia (COGS-1). Schizophr Res. 2015;163:73–9.

    Article  Google Scholar 

  54. Frank J, Lang M, Witt SH, Strohmaier J, Rujescu D, Cichon S, Degenhardt F, Nothen MM, Collier DA, Ripke S, et al. Identification of increased genetic risk scores for schizophrenia in treatment-resistant patients. Mol Psychiatry. 2015;20:150–1.

    Article  CAS  Google Scholar 

  55. Epstein JI, Keefe RSE, Roitman SL, Harvey PD, Mohs RC. Impact of neuroleptic medications on continuous performance test measures in schizophrenia. Biol Psychiatry. 1996;39:902–5.

    Article  CAS  Google Scholar 

  56. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.

    Article  CAS  Google Scholar 

  57. Overall JE, Gorham DR. The brief psychiatric rating-scale. Psychol Rep. 1962;10:799–812.

    Article  Google Scholar 

  58. Brebion G, Bressan RA, Amador X, Malaspina D, Gorman JM. Medications and verbal memory impairment in schizophrenia: the role of anticholinergic drugs. Psychol Med. 2004;34:369–74.

    Article  CAS  Google Scholar 

Download references


The authors thank Dr. Ding-Lieh Liao, MD, PhD (Taoyuan Psychiatric Center, Ministry of Health and Welfare, Taoyuan City, Taiwan), who was the Co-PI for the project entitled “Genome-Wide Association Study for Treatment Refractory Schizophrenia” conducted in multiple sites, including the Bali Psychiatric Center, and supported by Academia Sinica. Some of the participants in our study were selected from the project.


This study was supported by the National Health Research Institutes, Taiwan (NHRI-EX95, 96, 97, 98, 99-9511PP; NHRI-EX100-10048PI), a grant from the National Taiwan University (97HP0023), and a grant from the Bali Psychiatric Center (99R001). Funding agencies had no further roles in the study design; in the collection, analysis or interpretation of the data; in the writing of the report; or in the decision to submit the paper for publication.

Author information

Authors and Affiliations



ASL and WJC designed the study, wrote the protocol and ran the study. ASL and YCP acquired the data. ASL and WJC conducted statistical analyses. All authors contributed to literature review. ASL and WJC wrote initial drafts of the manuscript. ASL, WJC and HYC contributed to subsequent drafts with writing, editing, and final formatting. All authors contributed to and have approved the final manuscript.

Corresponding author

Correspondence to Wei J. Chen.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The Institutional Review Board of the Bali Psychiatric Center approved the study (IRB990309–01). We obtained written informed consent from all the participants after providing a complete description of the study. Each subject’s identifier was removed and replaced by a code.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Table S1. Pearson correlation coefficients of pairwise variables among demographic, clinical, and medication features. Table S2. Demographic and clinical characteristics in the study participants of TRS without CR. Table S3. Current dispositions and medications in the study participants of TRS without CR. Table S4. Adjusted z scores of d′ on Continuous Performance Test (CPT) in the study participants of TRS without CR. (DOCX 39 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, AS., Chan, HY., Peng, YC. et al. Severity in sustained attention impairment and clozapine-resistant schizophrenia: a retrospective study. BMC Psychiatry 19, 220 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: