- Research article
- Open Access
- Open Peer Review
An Asian study on clinical and psychological factors associated with personal recovery in people with psychosis
BMC Psychiatryvolume 19, Article number: 256 (2019)
Despite the rising recognition of personal recovery, there is a lack of research on personal recovery in individuals with psychosis in Singapore. This study aims to evaluate the psychometric properties of the QPR-15 using the CHIME personal recovery framework and to examine its associations with clinical recovery factors.
Sixty-six stable outpatients were recruited and assessed at two time points approximately 2 weeks apart. Convergent validity was examined through Spearman correlations with scores on CHIME-related psychological factors: connectedness (Ryff subscale- positive relations with others), hope (Herth Hope Index- abbreviated), identity (Ryff subscale- self-acceptance, Internalized Stigma of Mental Illness- Brief), meaning (World Health Organization Quality of Life Assessment-Brief Form), empowerment (Empowerment Scale). Pearson’s correlation was used to examine the test-retest reliability, while Cronbach’s alpha was used to examine internal consistency. The initial factor structure was evaluated via principal component analysis, Velicer’s minimum average partial (MAP) criteria, parallel analysis, and a scree plot. Spearman correlations and hierarchical multiple linear regression (controlling for age and gender) were employed to examine the association of clinical (symptoms and functioning) and psychological factors with the QPR-15.
The QPR-15 demonstrated convergent validity with all CHIME-related psychological factors (rs ranged from 0.472 to 0.687). Internal consistency was excellent (Cronbach’s alpha = 0.934), and test-retest reliability was adequate (r = 0.708). Initial factor structure evaluations revealed a one-factor model. Correlations of clinical factors with the QPR-15 were mostly low (rs ranged from − 0.105 to − 0.544) but significant, except for depressive symptoms (CDSS: rs = − 0.529 to − 0.544), while correlations were moderate for psychological factors. Clinical factors significantly explained 28.3–31.8% of the variance of the QPR-15. Adding psychological factors significantly increased the model variance at baseline (∆ adjusted R2 = 0.369, F change < 0.001) and at time point 2 (∆ adjusted R2 = 0.208, F change < 0.001).
Our results provide preliminary evidence that the QPR-15 has adequate psychometric properties in Singapore and encompasses the CHIME personal recovery framework. In addition, our results suggest that clinical recovery and personal recovery are not substitutes for each other but rather are complementary, thereby promoting a more holistic evaluation of recovery in people with psychosis. Implications are discussed.
The concept of recovery in mental health has been re-examined, and recent developments have revealed two non-synonymous recovery constructs: clinical recovery (objective state, i.e., symptoms, functioning) and personal recovery (subjective process, i.e., attitude or life orientation) [1,2,3,4]. Findings from a previous study with 381 service users substantiate the importance of personal recovery, as it was found that the highest level of consensus on the definition of recovery was “recovery is the achievement of a personally acceptable quality of life” and “recovery is feeling better about yourself” . Therefore, this angle of recovery may only be assessable by the individuals themselves and may approximate us to a more holistic definition of recovery. Moreover, personal recovery impacts the quality of life of individuals with schizophrenia , and a reduction in psychiatric symptoms alone does not necessarily translate into higher personal recovery [7, 8]. Hence, it may be essential to consider personal recovery in the evaluation of overall recovery in people with psychosis.
Although it may be understood in clinical practice that some form of clinical recovery is essential for personal recovery to take place, the recovery movement has contested that personal recovery can take place without clinical recovery . In a recent study, Macpherson et al.  administered a series of measures and found that these measures eventually clustered into three factors (termed patient-rated personal recovery, patient-rated clinical recovery, and staff-rated clinical recovery). Although only patient-rated personal recovery (consisting of measures of personal recovery (QPR), empowerment, well-being and hope) had improved over the course of 1 year, closer examination shows that the change in patient-rated personal recovery scores was significantly correlated with the change in symptom scores. This finding suggested that clinical factors should not be forsaken, as they can affect personal recovery. There were other similar findings in the literature, as certain clinical factors were found to be correlated with  and predictive of  personal recovery as well as of recovery orientation . Clarifying the relationship between these two forms of recovery is essential for appropriate subsequent interventions, as we could promote synergy between the two  instead of having a trade-off based on their relative importance.
While it remains challenging to quantify personal recovery, several reviews have uncovered broad themes that are common in these subjective accounts of recovery [13,14,15,16]. Accordingly, several scales that aim to measure personal recovery have been developed, and these scales have been comprehensively reviewed within the previous two decades [17,18,19,20,21,22]. In 2011, Leamy and colleagues  adopted a systematic review and narrative synthesis approach to identify a conceptual framework that describes the process of recovery: connectedness; hope and optimism about the future; identity; meaning in life; and empowerment (CHIME). In contrast, with other frameworks that have been developed from limited samples or types of data, this framework was derived from 97 studies that consist of wider data sources, providing an empirical basis for related future work. Since then, the Questionnaire about the Process of Recovery (QPR) has been identified as the personal recovery measure that most closely maps to the CHIME framework .
To date, six studies have evaluated the psychometric properties of the QPR and have shown that it has good internal consistency, construct validity and test-retest reliability [25,26,27,28,29,30]. However, Williams and colleagues  found that the interpersonal subscale underperforms in terms of its psychometric properties and that the intrapersonal subscale overlaps substantially with the 15-item version (see methods for information on the QPR). Hence, they have recommended the 15-item version, as it is more robust and less burdensome. Two other studies had similar findings. Law and colleagues  found that the original 2-factor solution fit their data poorly and that the internal consistency could be improved by the removal of seven items. Similarly, Argentzell et al.  found that the psychometric properties of a brief Swedish QPR-16 version were better supported, where the items of factor 2 (interpersonal) had underperformed. With these findings, the shorter QPR-15 version may be a better choice in terms of psychometric properties and feasibility for clinical use.
The six existing QPR studies, however, have not been able to confirm the conclusion of Shanks and colleagues that the QPR maps to the CHIME framework most closely, as the CHIME framework has not been completely represented in these studies. Given that the current literature has not been comprehensive in its empirical method of testing, it remains uncertain if the QPR encompasses the CHIME framework, let alone the QPR-15 (shortened version).
Moreover, no studies on personal recovery from mental illnesses have been conducted in Singapore, as it is a relatively new concept in Asia . However, it was reported that Western concepts of personal recovery were applicable in Hong Kong [32,33,34], an Asian socio-cultural setting. Singapore is a country with a multi-ethnic and predominantly Asian society, with English as the main language of communication. Before the move towards recovery-oriented mental health services can occur, the applicability of valid personal recovery measures in our socio-cultural setting is one of the steps required. Furthermore, more recovery research has been encouraged in culturally dissimilar societies .
Therefore, one of the aims of the current study is to evaluate the psychometric properties of the QPR-15 in Singapore. We aim to test its validity using the CHIME framework and to examine its initial factor structure and its reliability in terms of internal consistency and test-retest reliability. In addition, we aim to examine the associations of personal recovery with clinical and psychological factors, as it remains unclear how the two forms of recovery should be viewed and applied clinically. Although two QPR studies [8, 28] have included clinical factors, the authors did not enter them into a single model to represent clinical recovery in the analysis. We hypothesise that compared to psychological factors, clinical factors will have significant but lower associations with personal recovery.
Participants were outpatients recruited from the Institute of Mental Health (IMH) in Singapore. Inclusion criteria were (a) diagnoses of schizophrenia and schizoaffective disorders, (b) ability to speak and understand English well enough to complete the measures, (c) ability to give informed consent, and (d) age between 21 and 65 years old. The exclusion criteria were (a) current illicit substance use, (b) neurological disorders, and (c) intellectual disability.
Design and procedures
Two assessments were conducted, with the second assessment scheduled approximately 2 weeks after the baseline assessment. Diagnoses were ascertained using the Structured Clinical Interview for DSM-IV-TR Axis I Disorders in the first assessment. The baseline assessment included the following: socio-demographic information; the QPR-15; and clinical factors consisting of the Positive and Negative Symptoms Scale (PANSS), the Calgary Depression Scale for Schizophrenia (CDSS), and the Personal and Social Performance Scale (PSP). Due to concerns related to assessment burden, the assessment of psychological factors was separated between the two time points, approximately 2 weeks apart. Hence, the baseline psychological factors assessed were the Herth Hope Index-abbreviated (HHI- abbreviated), the Internalized Stigma of Mental Illness Scale-Brief (ISMI-Brief), and the Empowerment Scale. Psychological factors assessed at time point 2 were the World Health Organization Quality of Life Assessment-Brief Form (WHOQOL-BREF) and the subscales of self-acceptance and positive relations with others from the Ryff Scales of Well-Being (Ryff). The QPR-15 and the clinical scales that were assessed at the baseline assessment were also assessed at time point 2. The psychological factors selected are the constituents of the recovery process themed by Leamy et al.  as CHIME (refer to Table 2 of their paper). All assessors were trained in the conduct of the scales. Ethics approval was provided by the National Healthcare Group’s Domain-Specific Review Board. Informed consent from all participants was obtained prior to the baseline assessment.
The questionnaire about the process of recovery (QPR-15)
The QPR is one of the tools developed in collaboration with service users through interviews to generate themes and items of the scale in the UK . The items were generated based on the findings of Pitt et al.: themes of rebuilding life (subtheme: active participation in life, rebuilding social support), rebuilding self (subtheme: understanding of self, empowerment) and hope for a better future (subtheme: process of change, desire for change) . Two service-user researchers were part of the research team, and a steering committee of 10 service users was consulted at each stage of the research . Service users’ review of the measure was positive (easy and quick to complete, positive language and items, and items reflecting the wider aims of recovery) . The initial 22-item version had two subscales: QPR intrapersonal and QPR interpersonal. The intrapersonal subscale refers to tasks that individuals are responsible for carrying out and that they complete to rebuild their lives, while the interpersonal subscale refers to individuals’ ability to reflect on their value in the external world and on how recovery is facilitated by external processes and interpersonal relationships with others . The QPR-22, however, has since been revised to 15 items, with a one-factor solution called the QPR-total . The evaluation of the 15-item version has shown adequate convergent validity (r = 0.73), test-retest reliability (r = 0.70–0.74), sensitivity to change (r = 0.40) and internal consistency (α = 0.93) [27, 28]. The QPR is a self-rated scale, scored using a 5-point Likert scale ranging from 0 (disagree strongly) to 4 (agree strongly).
Positive and negative syndrome scale (PANSS)
Symptoms were assessed on the PANSS by trained raters. The scale has been validated locally and found to comprise five factors : positive, negative, excitement, depression and cognitive.
Calgary depression scale for schizophrenia (CDSS)
The CDSS is a rating scale developed for assessing the severity of depressive symptoms in schizophrenia . It is a 9-item observer-rated measure with a global score range of 0–27. Its psychometric properties have been extensively explored [39,40,41,42], and it proves to be a reliable and valid tool.
Personal and social performance scale (PSP)
The PSP  is an observer-rated functioning scale, assessed through four domains: 1) socially useful activities, 2) personal and social relationships, 3) self-care and 4) disturbing and aggressive behaviours. The total score ranges from 0 to 100, with a higher score indicating higher functioning. Its validity, internal consistency, test-retest reliability and inter-rater reliability have been established [44,45,46,47,48]. It has been shown to have the ability to discriminate between groups of patients with different symptom severities [44, 45].
Herth Hope index (HHI)-abbreviated
The HHI-abbreviated version  is a 12-item self-rated scale that measures hope based on a) temporality and future, b) positive readiness and expectancy, and c) interconnectedness. It is scored using a four-point Likert scale ranging from 1 (strongly disagree) to 4 (strongly agree), in which a higher score is indicative of higher levels of hope. It has been demonstrated to have good reliability and test-retest reliability, as well as having criterion and divergent validity . The scale’s internal consistency was also good (Cronbach’s α = 0.90) when used in our sample.
The HHI-abbreviated was selected to represent the domain of hope and optimism about the future of the CHIME recovery framework; 79% of the studies have reported hope and optimism about the future as part of the recovery process .
Internalized stigma of mental illness scale (ISMI)-brief
The 10-item ISMI  is a self-rated scale that measures internalized stigma with the following subscales: alienation, discrimination experience, social withdrawal, stereotype endorsement, and stigma resistance. It possesses adequate internal consistency and construct validity. In our sample, its internal consistency was good (Cronbach’s α = 0.81). It is scored on a 4-point Likert scale (1 = strongly disagree to 4 = strongly agree), with higher scores indicative of greater internalized stigma.
The ISMI-Brief was selected to represent the domain of identity of the CHIME recovery framework; 46% of studies have reported overcoming stigma as part of the recovery process .
The Empowerment Scale  is a 28-item self-rated instrument that measures empowerment as defined by consumers of mental health services, based on five factors: self-efficacy/self-esteem, power/powerlessness, community/activism, righteous/anger, and optimism/control over the future. It has high internal consistency and construct validity  and has been validated in an outpatient mental health population . In our sample, its internal consistency was good (Cronbach’s α = 0.71). The scale is rated on a four-point Likert scale (1 = strongly disagree to 4 = strongly agree), with higher scores representing higher endorsement of empowerment.
The Empowerment Scale was selected to represent the domain of empowerment in the CHIME recovery framework; 91% of the studies reported empowerment as part of the recovery process .
World Health Organization quality of life assessment-brief form (WHOQOL-BREF)
The WHOQOL-BREF  is a 26-item self-rating scale that measures one’s subjective QOL based on four domains: physical health (7 items), psychological health (6 items), social relationships (3 items) and environment (8 items). It also contains two items assessing the overall perception of QOL and overall health satisfaction. The scale was developed based on the concept of QOL as “an individual’s perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns” (p.5) . It has adequate internal consistency, discriminant validity (illness versus healthy samples), and validity, as a factor analysis supported a 4-factor structure . In our sample, it has good internal consistency (Cronbach’s α = 0.94). It is rated on a five-point scale (1 = very poor, 2 = poor, 3 = neither poor nor good, 4 = good, and 5 = very good), with higher scores reflecting greater QOL.
The WHOQOL-BREF was selected to represent the domain of meaning in life in the CHIME recovery framework; 65% of the studies reported having quality of life as part of meaning in life . Given that there is an item in the WHOQOL-BREF (item 6) that directly assesses meaning in life (“to what extent do you feel your life to be meaningful”), we will also use this single item to represent meaning in life itself, as 66% of the studies have reported this quality to be important in the recovery process.
Ryff scales of well-being
The Ryff Scales of Well-Being  measure psychological well-being (eudaimonia happiness). Two subscale scores were used: self-acceptance (9 items) and positive relations with others (9 items). The internal consistencies of these two subscales in our sample were good (self-acceptance: Cronbach’s α = 0.76; positive relations with others: Cronbach’s α = 0.80). It is rated on a scale of 1 (strongly disagree) to 6 (strongly agree). The self-acceptance subscale was selected to reflect the domain of identity in the CHIME recovery framework; 75% of the studies reported identity as important in the recovery process. Positive relations with others subscale was selected to reflect the domain of connectedness; 86% of the studies reported connectedness to be important in the recovery process .
All data were analysed using IBM SPSS Statistics, version 23 (IBM SPSS, Armonk, N.Y., USA), except the post hoc power analysis, which was conducted on G*power (version 3.1) . Total scores were used for all scales except the subscale scores of the Ryff Scales of Psychological Well-Being (self-acceptance and positive relations with others) and the single item score of the WHOQOL-BREF (item 6: meaning in life). Convergent validity with psychological factors was assessed using Spearman correlations, as the variables were of non-normal distribution. Reliability in terms of internal consistency and test-retest reliability were assessed. Internal consistency of items was assessed using Cronbach’s alpha coefficient. Corrected item-total correlations and Cronbach’s alphas if an item were deleted were also examined. Items were considered redundant if the item-total correlation was < 0.3  or if deleted items would substantially increase the Cronbach’s alpha (> 0.5) . Test-retest reliability was assessed using Pearson’s correlation on QPR-15 data collected at baseline and follow-up, as the data were normally distributed.
The initial factor structure of the QPR-15 was evaluated via principal component analysis. A scree plot, Velicer’s minimum average partial (MAP) criteria and parallel analysis were used to estimate the component structure.
Spearman correlations were used to evaluate the associations of the QPR-15 with psychological and clinical factors. The correlation coefficient was interpreted according to the following limits: ± 0–0.3 as little, ± 0.3–0.5 as low, ± 0.5–0.7 as moderate, ± 0.7–0.9 as high and ± 0.9–1 as very high . Hierarchical multiple linear regression was used to examine the relationships among clinical factors, CHIME-related psychological factors and personal recovery. Psychological and clinical factors that had significant correlations with the QPR-15 were entered into the model, which was run separately for the two time points. This was a two-stage model with clinical factors entered in the first stage and psychological factors entered in the second stage. This sequence was determined based on the expectation that psychological factors would have higher predictive value for personal recovery . To detect the issue of multicollinearity in hierarchical multiple regression, a Variance Inflation Factor (VIF) of 2 was chosen as a cut-off for stricter control of collinearity. Statistical significance was set at p < 0.05.
Spearman correlations between the QPR-15 and all other measures are shown in Table 3. The QPR-15 had significant and moderate associations with all of the CHIME themes that represent connectedness (Ryff positive relations with others: rs = 0.633, p < 0.001), hope and optimism about the future (HHI: rs = 0.687, p < 0.001), identity (ISMI: rs = − 0.686, p < 0.001; Ryff self-acceptance: rs = 0.521, p < 0.001), meaning in life (WHOQOL-BREF: rs = 0.669, p < 0.001), and empowerment (Empowerment Scale: rs = 0.547, p < 0.001). The only low correlation was with WHOQOL-BREF item 6 (CHIME theme of meaning in life; rs = 0.472, p < 0.001).
Cronbach’s alpha coefficient for the QPR-15 items revealed excellent internal consistency (α = 0.934). The corrected item-total correlations and Cronbach’s alpha are shown in Table 4. There were no items that had negative correlations or corrected item-total correlations of below 0.3. In addition, none of the items, if removed, would lead to a substantial improvement in the Cronbach’s alpha of the measure as a whole (Items 4 and 15: increase in α by 0.001). Hence, no items were considered redundant. The QPR-15 was also found to have good test-retest reliability (r = 0.708, p < 0.001).
Initial factor structure
The item loadings are reflected in Table 5. As variance accounted for might be inflated with a small sample , this was not reported. On examination of the scree plot (Additional file 1: Figure S1), one component was suggested to be retained, but results from both Velicer’s MAP criteria and parallel analysis indicated the retention of two components. Because fewer than 3 items  had higher factor loadings on component 2, component 2 was not retained. Furthermore, all item loadings were > 0.4 for the first factor.
Factors associated with the QPR-15
As mentioned previously, the QPR-15 had significant moderate correlations with psychological factors (rs range from 0.521 to 0.687), except for item 6 of the WHOQOL-BREF (rs = 0.472), which was low. The correlations of the QPR-15 with clinical factors were mostly significant but low (rs range from − 0.105 to − 0.544). The only clinical factor that had a moderate correlation with the QPR-15 was depressive symptoms (CDSS: rs = − 0.529 to − 0.544). The PANSS excitement factor at baseline had little correlation with the QPR-15, while the PANSS excitement factor at time point 2 and the PANSS cognitive factor did not have significant correlations with the QPR-15. The rest of the clinical factors had low correlations with the QPR-15.
Next, we entered factors that had significant correlations with the QPR-15 into a hierarchical multiple linear regression model. The regressions were performed separately for the two study visits. Variables were entered into two stages. Clinical factors (PANSS, CDSS and PSP), age and gender were entered first, and psychological factors were entered in the next stage. Clinical factors were entered first as clinical factors and had lower correlation coefficients with the QPR-15 than did psychological factors. The variables were entered simultaneously at each stage. Multicollinearity was detected when all psychological factors were added at stage two of both time points. Thus, only the HHI (VIF 1.276), which had the highest correlation with the QPR-15 at baseline, was entered into the regression model. The same process was performed at time point 2 and yielded the same multicollinearity issues. Thus, only the WHOQOL-BREF (VIF 1.889), which had the highest correlation with the QPR-15 at time point 2, was entered into the regression model.
Regression models are shown in Table 5. The first stage models for the baseline (F change = 5.335, p < 0.001; adjusted R2 = 0.318) and time point 2 (F change = 4.661, p < 0.001; adjusted R2 = 0.283) were significant. The strongest predictors among the clinical factors were depressive symptoms (β = − 0.404, p = 0.002) and negative symptoms (β = − 0.293, p = 0.011) at baseline and depressive symptoms (β = − 0.219, p = 0.014) at time point 2. Depressive symptoms (CDSS) continue to be significant at stage two of the baseline when only the HHI was entered into the model. The inclusion of one psychological factor also significantly improved the model variances at baseline (F change = 69.332, p < 0.001; adjusted R2 = 0.687) and at time point 2 (F change = 24.744, p < 0.001; adjusted R2 = 0.491) in the second stage.
All the CHIME-related psychological factors were also entered into the model at the second stage of both time points, despite the multicollinearity involved. This procedure was followed to obtain the combined variance accounted for without examining the individual prediction statistics. After controlling for clinical factors, age and gender, the psychological factors representative of the CHIME framework explained an additional 38.4% variance of the QPR-15 at baseline and 22.5% at time point 2. The clinical factors were also no longer statistically significant in predicting the QPR-15.
The current study examined the psychometric properties of the QPR-15 in Singapore, as well as the association between clinical and personal recovery. Our results demonstrate that the QPR-15 has adequate psychometric properties in our socio-cultural setting, possessing CHIME-consistent convergent validity, internal consistency, test-retest reliability and a one-factor structure. To our knowledge, this is the first study that has found empirical evidence for the QPR-15 to represent the CHIME personal recovery framework, as prior QPR studies had excluded the connectedness component and internalized stigma as a subcomponent of identity. Our data also revealed that clinical factors had significant little to moderate (mostly low) correlations with the QPR-15 and explained a significant proportion of variance of the QPR-15; however, this association was no longer statistically significant when all the CHIME-related psychological factors were added into the hierarchical multiple linear regression model. This finding suggested that although psychological factors have a larger contribution to personal recovery than clinical factors, clinical factors still have a complementary role in personal recovery.
The psychometric properties of the QPR-15 obtained from our study are comparable to those found in previous QPR studies. We report an initial factor structure of one factor, which is consistent with the findings of prior QPR studies [25, 27, 28] that had recommended the briefer version of the QPR (15–16 items) but not with the findings of studies providing support for the full version [26, 29, 30]. With regards to convergent validity, the QPR-15 in our study had moderately significant correlation coefficients with subjective scales of psychological factors. This finding is in line with those of other QPR studies (rs = 0.5–0.7). However, it should be noted that among the psychological factors in our study, only the correlation of WHOQOL-BREF item 6 with the QPR-15 (rs = 0.472) was low. Using a single item (item 6) of the WHOQOL-BREF to represent meaning in life might not have been suitable because a more comprehensive measure would have been more valid. The use of a single item could have limited the strength of the correlation between meaning in life and the QPR-15. Nonetheless, Leamy and colleagues  reported that 65% of the studies they reviewed had endorsed quality of life as important to the recovery process, categorised under the domain of meaning in life (66% of studies endorsed meaning in life itself). The fact that the QPR-15 showed a moderate correlation with the total WHOQOL-BREF (quality of life) (rs = 0.669) in the current study thus supports its convergent validity with the CHIME domain of meaning in life. Overall, our results provide preliminary evidence for the validity and reliability of the QPR-15 in our socio-cultural setting.
Our results demonstrated that the main clinical predictor of the QPR-15 was depressive symptoms, which is consistent with several studies [3, 7, 8, 11, 60] that examined the relationship between clinical and personal recovery. A recent meta-analysis investigating the association between clinical and personal recovery found a higher mean weighted effect size for affective symptoms compared to symptoms and functioning . Jørgensen et al.  also found that the only symptom index that was consistently linked with overall personal recovery over four time points (baseline, 3 months, 6 months and 12 months) was the emotional discomfort factor (depression, anxiety and guilt) of the PANSS. Using the QPR-15, Law et al.  found that the QPR-15 scores at time point 2 were predicted by negative emotion (CDSS and negative self-esteem), positive self-esteem, hopelessness and, to a lesser extent, symptoms and functioning. Indeed, our results (Model 1 of both time points in Table 5) suggested that depressive symptoms were the clinical factor with the largest impact on personal recovery. Although depressive symptoms (CDSS) were not significant in the final model (time point 2) of our study, we postulate that the WHOQOL-BREF, through its evaluation of negative feelings, might have captured self-reported depressive symptoms. The results of Roe et al.  may also shed some light on how depressive symptoms can affect personal recovery. They found that although the total symptom score did not correlate with subjective recovery (Recovery Assessment Scale; RAS), the dimensions of mood were correlated with the hope domain of the RAS. Therefore, a greater severity of depressive symptoms may reduce one’s level of hope and hence affect one’s personal recovery.
Although our results suggested that psychological factors contributed more to personal recovery than did clinical factors, the relationships between psychological and clinical factors and their effects on personal recovery may be complex. We selected one psychological factor to be entered at stage 2 of the model due to collinearity among the factors. However, we found that inserting different psychological factors into the model produced different effects that clinical factors had on personal recovery. This finding suggests some indirect or interactional relationship amongst the variables, which is congruent with the results of a number of studies [6, 61,62,63,64]. For instance, Rossi et al.  found that in patients with schizophrenia, avolition (part of negative symptoms) has direct effects on depression, while it also has indirect effects on depression through internalised stigma and resilience. Internalized stigma was related to depression through the mediation of resilience. In addition, Jørgensen et al.  found that in addition to depressive symptoms, the relationship of symptom severity with personal recovery did not appear to be generally stable. Negative symptoms were linked to personal recovery at three time points but not one time point, while positive symptoms were linked to subjective recovery at one time point but not three time points. Similarly, we found that negative symptoms were predictive of subjective recovery at one time point (baseline, model 1) but not at time point two of our study. Jørgensen et al. proposed that the result may suggest influence from other factors, such that personal recovery may not be directly impacted by the immediate clinical state. This could also explain why Law et al. found functioning to be of higher significance than depressive symptoms in a cross-sectional study  but not in a longitudinal study . Thus, the result of the previously mentioned robust clinical predictor should also be interpreted with caution, as there may be indirect effects from other variables. The role of other clinical factors should not be dismissed. Future longitudinal research should take into account complex indirect or interactional relationships because these relationships can fluctuate due to interrelationships during the time period. This approach will further inform future clinical practice.
Nevertheless, consistent with our hypothesis, our current results showed that compared to psychological factors, clinical factors had lower but significant associations with personal recovery. The size of the correlation for clinical factors was little to moderate (mostly low except for the CDSS, which was moderate; the PANSS excitement correlation was none to little, and the PANSS cognition correlation was none). In contrast, the size of the correlations with psychological factors was moderate (except for WHOQOL-BREF item 6, which had a low correlation). Similarly, the hierarchical multiple linear regression models demonstrated that clinical factors explained a significant proportion of model variance of the QPR-15, albeit a lower proportion than that explained by psychological factors, before psychological factors were entered into the model. This finding is consistent with several studies that have stated that clinical recovery is not synonymous with personal recovery but rather is complementary to it [3, 7, 10, 11, 60]. Therefore, the present results suggest that clinical recovery does play a role in personal recovery.
There were two additional observations made from our results. We found that the HHI (i.e., hope) could explain more of the QPR-15 variance than the clinical factors combined. Perhaps hope is the cornerstone of personal recovery, fuelling one’s motivation to rebuild one’s life and self. It is also noted that self-rated measures of psychological factors can predict self-rated personal recovery compared to objective measures (rated by clinician or trained raters). This finding affirms that there is an aspect of recovery in people with psychosis that is subjective and not assessable by others’ judgement. This is also consistent with the study of Karow et al.  that found that service users’ rated remission was only predicted by their self-rated subjective well-being scores but not by objective measures of symptoms and functioning, as rated by psychiatrists.
There are several limitations in this study. The sample size was relatively small; nevertheless, the validation results obtained were consistent with published literature. In addition, a post hoc power analysis revealed that the hierarchical multiple linear regression analysis was adequately powered to detect the observed effects. However, it is advisable to explore the validity of the QPR using its original 22 items in future studies in a larger sample. We recognise that our small sample size was not suitable for factor analysis and hence consider it an initial factor structure using the dimension reduction method (PCA), in which the factor structure may change with larger sample sizes or with factor analysis. Because factor analysis takes into account the underlying structure caused by latent variables, it is a recommended method compared to dimension reduction methods. This approach could answer whether personal recovery is a latent structure that causes the manifest variables (CHIME-related psychological factors) to co-vary. As mentioned above, the usage of a single item (item 6) of the WHOQOL-BREF might not have been valid to represent meaning in life. Hence, future research is recommended to use a more comprehensive measure. Our clinical sample was limited to stable outpatients; therefore, the results might not be generalisable to inpatients or to those who are seriously ill. Our sample was also limited to people with psychosis and might not generalise to other clinical populations. Criterion validity in terms of predictive validity and sensitivity to change could not be examined given the cross-sectional nature of the study. This is an important consideration; as personal recovery measures should be employed as outcome measures to evaluate interventions. Future longitudinal interventional studies would allow for such investigations. Finally, due to the cross-sectional nature of the study, causal inferences cannot be made.
We have identified several future directions. First, there is a need to view recovery within an ecological framework. Although personal recovery is viewed as an individual construct, we need to recognise that individuals exist in a web of relationships with the family, the community and larger socio-political units . Hence, it is necessary to understand the interactions between individual characteristics and environmental factors (such as choice) . Second, as suggested by Leamy et al. , we need a deeper understanding of how these individual characteristics of hope, resilience, and empowerment are operating, i.e., how they are ignited and sustained. We have utilised the CHIME framework to guide us in conceptualising personal recovery. However, it remains uncertain if it applies the same way in our population as it did in other socio-cultural settings. Studies have shown or noted that culture and socio-political systems can mediate the operationalisation of the subcomponents of the CHIME framework [66, 67]. Thus, future research is required to evaluate the conceptualisation of personal recovery in Asian socio-cultural settings, the relevance of personal recovery, and the operationalisation of it. Qualitative work has been recommended for these purposes . As mentioned previously, the inter-relationships between clinical and psychological factors and their effect on personal recovery also warrant further work. More research is required before we can effectively capture personal recovery in our socio-cultural setting, hence establishing if the QPR-15 can be used for this purpose and to understand the relationship between personal recovery and clinical recovery. However, it is certain that clinical services will be better informed and thus will improve, both in their delivery and support (psychotherapeutic interventions and rehabilitation), if evaluations of recovery move beyond symptoms and functioning. The evaluation of personal recovery will help provide an index of how service users experience their social environments and themselves as individuals as they make sense of their strengths and challenges , since personal recovery is related to personal well-being and social inclusion, which may not be directly captured by clinical recovery .
The QPR-15 possesses adequate psychometric properties in a sample of outpatients with psychosis in Singapore. We have shown that the QPR-15 encompasses the CHIME personal recovery framework, supporting the conclusion made by Leamy and colleagues that the QPR most closely maps to this framework and therefore its usage to evaluate personal recovery. Our study has also clarified the relationship between personal and clinical recovery, supporting our hypothesis that there is a significant but lower association of clinical recovery factors with personal recovery. Therefore, it is essential to consider both forms of recovery as complementary to each other for a more holistic view of recovery in people with psychosis. However, further research is required to better inform clinical implications.
Availability of data and materials
The dataset supporting the conclusions of this article is not available due to ethical restrictions.
Calgary Depression Scale for Schizophrenia
Connectedness, Hope and Optimism about the future, Identity, Meaning in life, and Empowerment
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision
Herth Hope Index
- IBM SPSS:
International Business Machines Corporation- Statistical Package for the Social Sciences
Institute of Mental Health
Internalized Stigma of Mental Illness
Minimum Average Partial
Positive and Negative Syndrome Scale
Personal and Social Performance Scale
Questionnaire about the process of recovery
Variance Inflation Factor
World Health Organization Quality of Life Assessment- Brief form
Andresen R, Caputi P, Oades LG. Do clinical outcome measures assess consumer-defined recovery? Psychiatry Res. 2010;177(3):309–17.
Karow A, Naber D, Lambert M, Moritz S. Remission as perceived by people with schizophrenia, family members and psychiatrists. Eur Psychiatry. 2012;27(6):426–31.
Roe D, Mashiach-Eizenberg M, Lysaker PH. The relation between objective and subjective domains of recovery among persons with schizophrenia-related disorders. Schizophr Res. 2011;131(1–3):133–8.
Lavin D, Ryan P. Using quantitative research to measure recovery outcomes and correlates. Ir J Psychol Med. 2012;29(3):157–62.
Law H, Morrison AP. Recovery in psychosis: a Delphi study with experts by experience. Schizophr Bull. 2014;40(6):1347–55.
Kukla M, Lysaker PH, Roe D. Strong subjective recovery as a protective factor against the effects of positive symptoms on quality of life outcomes in schizophrenia. Compr Psychiatry. 2014;55(6):1363–8.
Resnick SG, Rosenheck RA, Lehman AF. An exploratory analysis of correlates of recovery. Psychiatr Serv. 2004;55(5):540–7.
Law H, Shryane N, Bentall RP, Morrison AP. Longitudinal predictors of subjective recovery in psychosis. Br J Psychiatry. 2016;209(1):48–53.
Davidson L, O'Connell MJ, Tondora J, Lawless M, Evans AC. Recovery in serious mental illness: a new wine or just a new bottle? Prof Psychol Res Pract. 2005;36(5):480–7.
Macpherson R, Pesola F, Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. The relationship between clinical and recovery dimensions of outcome in mental health. Schizophr Res. 2016;175(1–3):142–7.
Jørgensen R, Zoffmann V, Munk-Jørgensen P, Buck KD, Jensen SOW, Hansson L, Lysaker PH. Relationships over time of subjective and objective elements of recovery in persons with schizophreni. Psychiatry Res. 2015;228(1):14–9.
Silverstein SM, Bellack AS. A scientific agenda for the concept of recovery as it applies to schizophrenia. Clin Psychol Rev. 2008;28(7):1108–24.
Young SL, Ensing DS. Exploring recovery from the perspective of people with psychiatric disabilities. Psychiatr Rehabil J. 1999;22(3):219–31.
Jacobson N, Greenley D. What is recovery? A conceptual model and explication. Psychiatr Serv. 2001;52(4):482–5.
Andresen R, Oades L, Caputi P. The experience of recovery from schizophrenia: towards an empirically validated stage model. Aust N Z J Psychiatry. 2003;37(5):586–94.
Spaniol L, Wewiorski NJ, Gagne C, Anthony WA. The process of recovery from schizophrenia. Int Rev Psychiatry. 2002;14(4):327–36.
Theodora Campbell-Orde JC, Jenneth Carpenter H, Leff S. Measuring the promise: a compendium of recovery measures. In: Human Services Research Institute vol. II; 2005.
Sklar M, Groessl EJ, O'Connell M, Davidson L, Aarons GA. Instruments for measuring mental health recovery: a systematic review. Clin Psychol Rev. 2013;33(8):1082–95.
Burgess P, Pirkis J, Coombs T, Rosen A. Assessing the value of existing recovery measures for routine use in Australian mental health services. Aust N Z J Psychiatry. 2011;45(4):267–80.
Cavelti M, Kvrgic S, Beck EM, Kossowsky J, Vauth R. Assessing recovery from schizophrenia as an individual process. A review of self-report instruments. Eur Psychiatry. 2012;27(1):19–32.
Law H, Morrison A, Byrne R, Hodson E. Recovery from psychosis: a user informed review of self-report instruments for measuring recovery. J Ment Health. 2012;21(2):192–207.
Scheyett A, DeLuca J, Morgan C. Recovery in severe mental illnesses: a literature review of recovery measures. Soc Work Res. 2013;37(3):286–303.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry. 2011;199(6):445–52.
Shanks V, Williams J, Leamy M, Bird VJ, Le Boutillier C, Slade M. Measures of personal recovery: a systematic review. Psychiatr Serv. 2013;64(10):974–80.
Argentzell E, Hultqvist J, Neil S, Eklund M. Measuring personal recovery—psychometric properties of the Swedish questionnaire about the process of recovery (QPR-Swe). Nord J Psychiatry. 2017;71(7):529–35.
Kanehara A, Kotake R, Miyamoto Y, Kumakura Y, Morita K, Ishiura T, Shimizu K, Fujieda Y, Ando S, Kondo S, et al. The Japanese version of the questionnaire about the process of recovery: development and validity and reliability testing. BMC Psychiatry. 2017;17(1):360.
Williams J, Leamy M, Pesola F, Bird V, Boutillier CL, Slade M. Psychometric evaluation of the questionnaire about the process of recovery (QPR). Br J Psychiatry. 2015;207(6):551–5.
Law H, Neil ST, Dunn G, Morrison AP. Psychometric properties of the questionnaire about the process of recovery (QPR). Schizophr Res. 2014;156(2–3):184–9.
Neil ST, Kilbride M, Pittb L, Nothard S, Welford M, Sellwood W, Morrison AP. The questionnaire about the process of recovery (QPR): a measurement tool developed in collaboration with service users. Psychosis. 2009;1(2):145–55.
Chien WT, Chan ZCY. Chinese translation and validation of the questionnaire on the process of recovery in schizophrenia and other psychotic disorders. Res Nurs Health. 2013;36(4):400–11.
Chiu MYL, Wong FHT, Ho WWN. Rasch analysis of the SAMHSA recovery inventory for Chinese (SAMHSA-RIC). Int J Soc Psychiatry. 2014;60(3):254–62.
Ho WWN, Chiu MYL, Lo WTL, Yiu MGC. Recovery components as determinants of the health-related quality of life among patients with schizophrenia: structural equation modelling analysis. Aust N Z J Psychiatry. 2010;44(1):71–84.
Lam MML, Pearson V, Ng RMK, Chiu CPY, Law CW, Chen EYH. What does recovery from psychosis mean? Perceptions of young first-episode patients. Int J Soc Psychiatry. 2011;57(6):580–7.
Ng RMK, Pearson V, Lam M, Law CW, Chiu CPY, Chen EYH. What does recovery from schizophrenia mean? Perceptions of long-term patients. Int J Soc Psychiatry. 2008;54(2):118–30.
Slade M, Leamy M, Bacon F, Janosik M, Le Boutillier C, Williams J, Bird V. International differences in understanding recovery: systematic review. Epidemiol Psychiatric Sci. 2012;21(4):353–64.
Pitt L, Kilbride M, Nothard S, Welford M, Morrison AP. Researching recovery from psychosis: a user-led project. Psychiatr Bull. 2007;31(2):55–60.
Jiang J, Sim K, Lee J. Validated five-factor model of positive and negative syndrome scale for schizophrenia in Chinese population. Schizophr Res. 2013;143(1):38–43.
Addington D, Addington J, Schissel B. A depression rating scale for schizophrenics. Schizophr Res. 1990;3(4):247–51.
Addington D, Addington J, Maticka-Tyndale E. Specificity of the Calgary depression scale for schizophrenics. Schizophr Res. 1994;11(3):239–44.
Addington D, Addington J, Atkinson M. A psychometric comparison of the Calgary Depression Scale for Schizophrenia and the Hamilton Depression Rating Scale. Schizophrenia Res. 1996;19(2,3):205–12.
Lako IM, Bruggeman R, Knegtering H, Wiersma D, Schoevers RA, Slooff CJ, Taxis K. A systematic review of instruments to measure depressive symptoms in patients with schizophrenia. J Affect Disord. 2012;140(1):38–47.
Schennach R, Obermeier M, Seemüller F, Jäger M, Schmauss M, Laux G, Pfeiffer H, Naber D, Schmidt LG, Gaebel W, et al. Evaluating depressive symptoms in schizophrenia: a psychometric comparison of the Calgary depression scale for schizophrenia and the Hamilton depression rating scale. Psychopathology. 2012;45(5):276–85.
Morosini PL, Magliano L, Brambilla L, Ugolini S, Pioli R. Development, reliability and acceptability of a new version of the DSM-IV social and occupational functioning assessment scale (SOFAS) to assess routine social funtioning. Acta Psychiatr Scand. 2000;101(4):323–9.
Nasrallah H, Morosini P, Gagnon DD. Reliability, validity and ability to detect change of the personal and social performance scale in patients with stable schizophrenia. Psychiatry Res. 2008;161:213–24.
Nafees B, van Hanswijck de Jonge P, Stull D, Pascoe K, Price M, Clarke A, Turkington D. Reliability and validity of the personal and social performance scale in patients with schizophrenia. Schizophr Res. 2012;140(1–3):71–6.
Juckel G, Schaub D, Fuchs N, Naumann U, Uhl I, Witthaus H, Hargarter L, Bierhoff H-W, Brüne M. Validation of the personal and social performance (PSP) scale in a German sample of acutely ill patients with schizophrenia. Schizophr Res. 2008;104(1–3):287–93.
Kawata AK, Revicki DA. Psychometric properties of the personal and social performance scale (PSP) among individuals with schizophrenia living in the community. Qual Life Res. 2008;17(10):1247–56.
Patrick DL, Burns T, Morosini P, Rothman M, Gagnon DD, Wild D, Adriaenssen I. Reliability, validity and ability to detect change of the clinician-rated personal and social performance scale in patients with acute symptoms of schizophrenia. Curr Med Res Opin. 2009;25(2):325–38.
Herth K. Abbreviated instrument to measure hope: development and psychometric evaluation. J Adv Nurs. 1992;17(10):1251–9.
Boyd JE, Otilingam PG, DeForge BR. Brief version of the internalized stigma of mental illness (ISMI) scale: psychometric properties and relationship to depression, self esteem, recovery orientation, empowerment, and perceived devaluation and discrimination. Psychiatric Rehabil J. 2014;37(1):17–23.
Rogers ES, Chamberlin J, Ellison ML, Crean T. A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatr Serv. 1997;48(8):1042–7.
Wowra SA, McCarter R. Validation of the empowerment scale with an outpatient mental health population. Psychiatr Serv. 1999;50(7):959–61.
Organization WH: WHOQOL-BREF introduction, Administration, Scoring and Generic Version of the Assessment. 1996.
Skevington SM, Lotfy M, O'Connell KA. The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2004;13(2):299–310.
Ryff CD, Keyes CLM. The structure of psychological well-being revisited. J Pers Soc Psychol. 1995;69(4):719–27.
Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149–60.
Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5th ed. New York: Oxford University Press; 2015.
Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences; 2003.
Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. In: Boyle GJ, O'Gorman JG, Fogarty GJ, editors. Work and organisational psychology: Research methodology; Assessment and selection; Organisational change and development; Human resource and performance management; Emerging trends: Innovation/globalisation/technology, Vols 1–5. Thousand Oaks: Sage Publications, Inc; 2016. p. 125–36.
Van Eck RM, Burger TJ, Vellinga A, Schirmbeck F, de Haan L. The relationship between clinical and personal recovery in patients with schizophrenia Spectrum disorders: a systematic review and meta-analysis. Schizophr Bull. 2017;44(3):631–42.
Rossi A, Galderisi S, Rocca P, Bertolino A, Rucci P, Gibertoni D, Stratta P, Bucci P, Mucci A, Aguglia E, et al. Personal resources and depression in schizophrenia: the role of self-esteem, resilience and internalized stigma. Psychiatry Res. 2017;256:359–64.
Wickett A, Essman W, Beck-Jennings J, Davis L, McLlvried J, Lysaker PH. Cluster B and C personality traits, symptom correlates, and treatment utilization in Postacute schizophrenia. J Nerv Ment Dis. 2006;194(9):650–3.
Vauth R, Kleim B, Wirtz M, Corrigan PW. Self-efficacy and empowerment as outcomes of self-stigmatizing and coping in schizophrenia. Psychiatry Res. 2007;150(1):71–80.
Upthegrove R, Marwaha S, Birchwood M. Depression and schizophrenia: cause, consequence, or trans-diagnostic issue? Schizophr Bull. 2017;43(2):240–4.
Jacobson N, Farah D. Recovery through the lens of cultural diversity. Psychiatric Rehabil J. 2012;35(4):333–5.
Brijnath B. Applying the CHIME recovery framework in two culturally diverse Australian communities: qualitative results. Int J Soc Psychiatry. 2015;61(7):660–7.
van Weeghel J, van Zelst C, Boertien D, Hasson-Ohayon I. Conceptualizations, assessments, and implications of personal recovery in mental illness: a scoping review of systematic reviews and meta-analyses. Psychiatric Rehabil J. 2019;42(2):169–81.
Bird V, Leamy M, Tew J, Le Boutillier C, Williams J, Slade M. Fit for purpose? Validation of a conceptual framework for personal recovery with current mental health consumers. Aust New Zealand J Psychiatry. 2014;48(7):644–53.
Jose D, Ramachandra LK, Gandhi S, Desai G, Nagarajaiah. Consumer perspectives on the concept of recovery in schizophrenia: a systematic review. Asian J Psychiatr. 2015;14:13–8.
This research was supported by the Singapore Ministry of Health’s National Medical Research Council under the Centre Grant Programme (Grant No.: NMRC/CG/004/2013). JL was further supported by the National Healthcare Group’s Clinician Scientist Career Scheme (Grant No.: NHG- CSCS/15007). The funders had no role in the design and conduct of the study, or in the analysis and interpretation of study data and in writing the manuscript.
Ethics approval and consent to participate
All participants received an explanation of the study’s aim and provided written indication of informed consent. Participation was voluntary. This study was approved by the Ethical Committee: National Healthcare Group’s Domain Specific Review Board (Approval No. 2016/00179).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figure S1. Scree plot for the initial factor structure of QPR-15 in people with psychosis in Singapore (DOCX 212 kb)