- Research article
- Open Access
Factor structure and sex invariance of the temporal experience of pleasure scale (TEPS) in Chinese university students and clinical population
BMC Psychiatry volume 21, Article number: 378 (2021)
A motivation dimension of the core psychiatric symptom anhedonia additional has been suggested. The Temporal Experience of Pleasure Scale (TEPS) has been reported to assess anticipatory and consummatory pleasure separately in multiple factor-structure models. This study explored the factor structure of a Chinese version of the 18-item TEPS and further explored the measurement invariance of the TEPS across sex and clinical status (non-clinical, psychiatric).
Best-fit factor structure of the TEPS was examined in a non-clinical cohort of 7410 undergraduates, randomized into sample 1 (N = 3755) for exploratory factor analysis (EFA) and sample 2 (N = 3663) for confirmatory factor analysis (CFA). Additionally, serial CFA was conducted to evaluate measurement invariance across sex and between clinical (N = 313) and non-clinical (N = 341) samples.
EFA supported a new four-factor structure with a motivation component, based on the original two-factor model (consummatory pleasure with/without motivation drive, anticipatory pleasure with/without motivation drive). CFA confirmed the four-factor model as the best-fit structure and revealed a second-order hierarchy in non-clinical and clinical samples. Full scalar invariance was observed across clinical and non-clinical samples and across sex in the clinical sample; only partial scalar invariance was observed across sex in the non-clinical sample.
A four-factor structured TEPS can assess motivation-driving dimensions of anticipatory and consummatory pleasure, consistent with the recently advanced multidimensional structure of anhedonia. CFA and measurement invariance results support application of the TEPS for assessing motivation aspects of anhedonia.
Anhedonia, defined as a diminished or absent ability to experience pleasure , is a core symptom of several psychiatric disorders, most prominently including major depressive disorder (MDD) and schizophrenia [2,3,4]. In recent years, anhedonia has been linked to the increased risk of many other kinds of neuropsychiatric diseases, for example, Vaquero-Puyuelo D et al. found that anhedonia is a risk factor for Alzheimer’s disease in a longitudinal study . Several scales aimed at evaluating anhedonia have been developed. Some initial measurements, such as the Fawcett-Clark Pleasure Capacity Scale  and the Snaith-Hamilton Pleasure Scale , developed in the early 1980s and 1990s, respectively, treat anhedonia as a unitary construct. Meanwhile, research providing deeper insights into anhedonia has indicated that anhedonia should be considered as a complex, multidimensional concept with relations to multiple psychopathological processes, including processes in physical/social, consummatory/anticipatory, and motivation/experiential dimensions [8, 9]. Scales with a focus on the physical/social dimension, including the Revised Physical Anhedonia Scale and the Revised Social Anhedonia Scale, have been used to assess anhedonia in patients with schizophrenic spectrum disorders and in other clinical samples since the 1970s [10, 11].
In the last two decades, there has been a growing acceptance of the concepts of anticipatory and consummatory anhedonia based on a convergence of evidence from animal and human studies [12,13,14]. In response to this evolution in the field, Gard and colleagues developed the Temporal Experience of Pleasure Scale (TEPS), which was designed to reflect anticipatory and consummatory anhedonia . In response to a recent growing emphasis on motivational aspects of anhedonia existing beyond the consummatory/anticipatory dimension [16, 17], the Motivation and Pleasure Scale (self-report) was developed to assess motivational anhedonia . Although several scales assess anhedonia from a particular dimension perspective, a scale that encompasses the multi-dimensionality of anhedonia comprehensively has been lacking.
The TEPS has distinct advantages with respect to assessing anticipatory and consummatory anhedonia, and has been supported by substantial preclinical and nonclinical studies [19, 20]. It has also been translated into multiple language versions and demonstrated to be a reliable and valid scale for the measurement of anhedonia [21,22,23,24]. However, there is inconsistency among studies with respect to the factor structure of the TEPS. The initial TEPS validation study reported by Gard and colleagues, which was conducted with a sample of American university students, yielded a two-factor structure with anticipatory and consummatory factors . Subsequent studies of the French and German versions, conducted in both healthy controls and schizophrenic patients, replicated the two-factor structure proposed in the initial study [21,22,23]. However, the Italian and Persian versions were found to have three-factor structures wherein it appeared to be more suitable to subdivide anticipatory anhedonia into contextual and abstract anticipatory anhedonia [25, 26]. In 2012, Chan et al. developed a Chinese version of the TEPS that included two additional items, altering the scale from an 18-item to a 20-item version, and then reported the psychometric properties of the new 20-item version in a non-clinical sample of undergraduate students . Based on their findings, they proposed a four-factor structure for their 20- item TEPS, with the factors being consummatory contextual, consummatory abstract, anticipatory contextual, and anticipatory abstract . The addition of two items, however, made it difficult to compare the properties found for the 20-item version with other international studies of 18-item versions of the TEPS. Moreover, it seems that the abstract-contextual dimension divisions were made primarily to suit to the anticipatory pleasure construct, with less relevance to the consummatory pleasure construct. For example, the “abstract” consummatory factor items may also refer to specific aspects of contextual pleasure (e.g. item 2: The sound of crackling wood in the fireplace is very relaxing). Therefore, the factor structure and interpretation of the Chinese TEPS, particularly of the original 18-item version, needs further exploration in non-clinical and clinical samples.
Despite debates regarding its factor structure, the TEPS has continued to be used worldwide in patients with psychiatric disorders, and has been reported to have good reliability and validity for assessing degrees of consummatory and anticipatory anhedonia [21, 23, 28]. For instance, in a schizophrenia sample, an 18-item German version of the TEPS was found to have a Cronbach’s α of 0.85 for the full scale, and scores correlated with scores from self-rated anhedonia and clinician-rated apathy measures . Interestingly, impairments in consummatory pleasure and anticipatory pleasure appear to be distinguishable and distinct across different psychiatric disorders. Schizophrenics have been found to have reduced anticipatory pleasure, compared to healthy controls, but an intact capacity for consummatory pleasure [20, 29, 30], whereas patients with obsessive-compulsive disorder have reduced consummatory pleasure with intact anticipatory pleasure , and patients with MDD have reduced anticipatory and consummatory pleasure .
The aforementioned studies indicate that anhedonia is a multidimensional construction and that understanding the pathology of anhedonia involves distinguishing among its components. However, the question of how these differences may contribute to authentic differences between clinical and non-clinical samples remains to be clarified. Furthermore, there remains a need for analyses of the measurement invariance of the TEPS across different populations. Measurement invariance, which is an index of the stability of the meanings of scale items and factor structure across different populations, can be determined through a series of confirmatory factor analyses (CFAs) with increasingly constrained conditions enabling researchers to confirm that differences observed between groups reflect true differences between groups rather than an artifact of the scale being used .
Sex differences in anhedonia have also been reported between different psychiatric disorder populations. For example, schizophrenic male score higher than schizophrenic female on physical anhedonia and social anhedonia measures . Additionally, trait anhedonia in female, but not male, alcoholics can predict depressiveness at the end of detoxification . Although measurement invariance across sex has been reported for the TEPS in a healthy population sample , measurement invariance of the TEPS across sex in populations with psychiatric disorders has not been established. Such measurement invariance is important for the development of individualized clinical treatment plans in light of differing anhedonia scale findings between males and females.
The present study pursued four aims. Firstly, the reliability including internal consistency reliability and retest reliability of 18-item version of TEPS were explored in this study. Secondly, we used combined exploratory factor analysis (EFA) and CFA to determine the best-fit factor structure of a Chinese version of the 18-item TEPS in non-clinical and clinical samples. Thirdly, we explored the psychological mechanism of anhedonia revealed by that factor structure. Additionally, we used the best-fit factor structure to probe measurement invariance across clinical and non-clinical samples and across sex groups.
Sample and procedure
We recruited 7418 college students from two universities in Hunan Province to take part in this study and randomized them into two samples: one used for EFA to probe the factor structure of the TEPS (Nsample1 = 3755); and the other used for CFA (Nsample2 = 3663). Sample 1 consisted of 1987 (52.9%) males and 1768 (47.1%) females. Sample 2 consisted of 1939 (52.9%) males and 1724 (47.1%) females. The two samples had similar mean TEPS total scores [t = 0.660, degrees of freedom (df) = 7415, p = 0.511]. A subset of 312 college students (72 males, 23.1%; and 240 females, 76.9%) were selected randomly for retesting 4 weeks later.
Sample 3 was constituted by 313 psychiatric outpatients (158, 50.5% males; and 155, 49.5% females) from the second Xiangya Hospital who had been diagnosed by two psychiatrists according to the fourth Diagnostic and Statistical Manual of Mental Disorder (DSM-IV). This sample included 94 outpatients diagnosed with major depressive disorder (MDD), 29 outpatients diagnosed with schizophrenia, and 190 outpatients diagnosed with a personality disorders (obsessive-compulsive disorder, schizotypal personality disorder, among others). Sample 4 consisted of 341 healthy control individuals (171, 50.1% males; and 170, 49.9% females) recruited from the university and surrounding community to be demographically similar to Sample 3.
We used posters and advertisements to recruit participants from universities, communities, and hospitals. The group-administeredpaper-pencil measure was taken to collect data from volunteered participants with two well-trained psychological postgraduate researchers’ guidance in a quiet room. All questionnaires were returned immediately after participants accomplish and were checked whether existing missing items. We choose group-administered measure in sample1, sample2, and sample 4, while single-administered measure in sample 3. All participants provided written informed consent.
The standard TEPS is a self-report questionnaire designed to assess anhedonia severity in adolescents and adults. It consists of 18 items, each of which is rated from 1 (very false for me) to 6 (very true for me); item 7 is reverse coded. Total TEPS scores range from 18 to 108, with a lower score reflecting a greater severity of anhedonia. The TEPS has been demonstrated to have excellent reliability and discrimination validity in various samples, and our initial research showed an internal consistency reliability is 0.79 and retest reliability is 0.81 . In this study, we report mean (M) TEPS scores with standard deviations (SDs).
A Chinese version of the 18-item TEPS was developed according to the second edition of International Test Commission (ITC) Guidelines for Translating and Adapting , which includes four steps to obtain a credible translated and culturally adapted instrument. Firstly, permission for the translation and adaption of the TEPS in China was obtained from the initial original creators of the TEPS. Secondly, two psychologists translated the original English-language TEPS to Chinese with full consideration of Chinese culture in the process of translation. Thirdly, another bilingual expert who was unaware of the original version translated the Chinese version to English and then comparing and adjusting for contradictions between the original English version and the back-translated English version. Finally, we evaluated the scale in ten undergraduate students and according to their feedback to conduct the final adjustment, and determine the final Chinese version of TEPS.
Three reliability coefficients including Cronbach’s α, mean inter-item correlation (MIC) values, and McDonald’s omega were used to assess the internal reliability of the TEPS in all four samples. For detail, Cronbach’s α above 0.70 can acceptable , the optimal MIC ranged 0.10–0.40 , and the McDonald’s omega above 0.70 can acceptable . The retest reliability was assessed with Spearman correlation analysis .
EFA to probe the adaptive factor structure of the TEPS was conducted with Sample 1. First, we applied the traditional criterion to determine the number of factors to retain, wherein the eigenvalues-greater-than-one rule was applied [41, 42]. Second, we conducted parallel analysis in M-plus (version 7.0)  based on a comparison between eigenvalues from a factor analysis of the actual data and eigenvalues from a factor analysis of a random dataset (1000 random permutations of the original data); the number of factors retained was based on the number of actual data eigenvalues in the upper 95% confidence limit of the random data eigenvalues [44, 45]. Third, Velicer’s minimum average partial (MAP) test was conducted in SPSS (version 25.0, IBM, 2017) to determine the number of factors to retain. The MAP test is focused on the relative amounts of systematic and non-systematic variance remaining in a correlation matrix after extractions of increasing numbers of components [46, 47]. Finally, we considered the variance of the outputs of these methods (eigenvalues-greater-than-one rule, parallel analysis, and MAP test), and compared the model fits of solutions with different numbers of factors obtained from the above methods in M-plus (version 7.0).
This study used a maximum likelihood with robust standards errors (MLR) method rather than the maximum likelihood method to extract factors because the latter requires data to be normally distributed, which was too restrictive for the present study, and because MLR is an optimal choice even for normally distributed data owing to its yielding the best combination of accurate standard errors and Type 1 errors . Oblique rotation was used because of the interrelatedness of the factors.
A series of CFAs were conducted to compare two previously proposed structure models in the literature (the Gard model and the Chan model) with the factor model developed in this study with Samples 2. The Gard model has a two-factor structure, with a consummatory pleasure factor (items 2, 4, 5, 6, 8, 9, 10, 13) and a anticipatory pleasure factor (items 1, 3, 7, 11, 12, 14, 15, 16, 17, 18) . The Chan model has a four-factor structure, including contextual consummatory pleasure (items 2, 3, 10, 17), abstract consummatory pleasure (items 4, 5, 6, 8, 13), contextual anticipatory pleasure (items 9, 11, 12, 14, 18), and abstract anticipatory pleasure (items 1,15,16) factors. The two additional items added by Chan and colleagues were attributed to the contextual anticipatory (item 19) and abstract consummatory (item 20) factors , and item 7 was omitted. The best fit factor model according to our EFA results was accepted as a final model. Overall, three confirmatory factor analyses were conducted in this study: Gard model (two-factor structure,18 items), Chan model (four-factor structure, 20 items), and new factor structure found in this study according to results of EFA analysis (18 items). The following model fit indices were applied: Tucker-Lewis index (TLI) ≥ 0.90, comparative fit index (CFI) ≥ 0.90, root mean square error of approximation (RMSEA) ≤ 0.08, and the standardized root mean square residual (SRMR) ≤ 0.08 [49,50,51].
Convergent validity and discriminate validity
The convergent validity and discriminate validity of the best fit factor structure obtained from the results of EFA and CFA were assessed in sample 2. The composite reliability (CR) was used to represent the convergent validity in this study and the cut-off criteria is set above 0.60 . The hetereotrait-monotrait ratio (HTMT) of correlations was used to represent the discriminate validity and the cut-off criteria is set below 0.85 .
Sample 3 (clinical) and Sample 4 (non-clinical) were used to probe measurement invariance across clinical and non-clinical samples. Samples 1 and 2 were used together to assess measurement invariance across sex in a non-clinical sample and Sample 3 was used to assess measurement invariance across sex in a clinical sample. The final model obtained by CFA was applied to these measurement invariance analyses. Four measurement invariance models with increasing cross-group restrictions on parameters were applied: (1) configural invariance, which tests factor structure invariance of factor latent variables across groups; (2) metric invariance, which tests factor loading invariance across groups; (3) scalar invariance, which tests intercept invariance across groups; and (4) strict invariance, which tests error variance invariance across groups . In the event of failed metric or scalar invariance, indices need to be modified to determine items in which factor loadings and intercepts failed to reach invariance, and constrictions for these items need to be relaxed.
CFI and RMSEA differences between increasingly constrained models, termed ΔCFI and ΔRMSEA, were used to evaluate model suitability for model confirmation. The criteria for acceptable invariance were ΔCFI ≤0.01, ΔRMSEA ≤0.01 and smaller Bayesian information criterion (BIC) [54, 55].
Descriptive statistics and reliability
In Sample 1, TEPS total scores ranged from 26.00 to 108.00 (77.57 ± 12.30), with a Cronbach’s α, McDonald’s omega, and MIC values of 0.83, 0.84, and 0.22, respectively. In Sample 2, TEPS total scores ranged from 23.00 to 108.00 (77.38 ± 12.60), with a Cronbach’s α, McDonald’s omega, and MIC value of 0.84, 0.85, and 0.23, respectively. In Sample 3, TEPS total scores ranged from 22.00 to 108.00 (71.35 ± 15.86), with a Cronbach’s α, McDonald’s omega, and MIC value of 0.87,0.88, and 0.28, respectively. In Sample 4, TEPS total scores ranged from 29.00 to 108.00 (74.62 ± 12.96), with a Cronbach’s α, McDonald’s omega, and MIC value of 0.84,0.85, and 0.23, respectively. The retest reliability of the total scale calculated by Spearman correlation analysis was 0.70 (p < 0.05). Compared to the non-clinical Sample 4, the clinical Sample 3 had lower TEPS scores (t = 2.869, df = 603.60, p = 0.004, Cohen’s d = 0.23), which indicated that clinical sample 3 showed more serious degree of anhedonia.
EFA of the structure of the TEPS
The eigenvalues-greater-than-one rule suggested we retain four factors, MAP testing suggested we retain two factors, and parallel analysis suggested we retain three factors. Comparing the model fit indices of these three different solutions which showed in Table 1, we found that the four-factor structure was the best solution (factor loadings in Table 2) and thus retained the four-factor structure.
The item composition of the retained four-factor structure was as follows: factor 1, items 2, 4, 5, 6, 8, and 13; factor 2, items 9, 10, 11, and 12; factor 3, items 1,15, and 16; and factor 4, items 3, 7, 14, 17, and 18. Analyzing item contents, we found that it was possible to subdivide the consummatory pleasure and anticipatory pleasure factors into with and without motivation dimensions, generating consummatory pleasure with/without motivation-driving subscales as well as anticipatory pleasure with/without motivation-driving subscales. Items in the with motivation-driving subscales reflects motivation to take action to satisfy a desire, whereas those in the without motivation-driving subscale represent in-the-moment enjoyment (consummatory) or the expectation to enjoy a pleasure (anticipatory) without any motivation to take action.
CFA of the structure of the TEPS
As shown in Table 3, CFA indicated that our newly explored structure had a better fit factor structure (i.e. better fit index values) than Gard’s and Chan’s models, both in our non-clinical undergraduate sample and our clinical sample. Follow-upsecond-level CFA from a consummatory-anticipatorysecond-order view indicated that the second-level model fits well in both samples (Table 3). In addition, the Second-order model of the Chinese version of the 18-item TEPS both in undergraduate students can reference Fig. 1. Meanwhile, this study also conducted CFAs in the clinical sample 3 to test whether factor structure found in university students is equally in clinical sample, the detailed results is shown in Table S1 in supplementary material.
Convergent validity and discriminate validity
For the convergent validity, the CR for the consummatory pleasure with/without motivation driving and anticipatory pleasure with/without motivation driving is 0.65, 0.73, 0.71 and 0.71 respectively, all above 0.60 that showed the new four-factor structure found in this study with good convergent validity. For the discriminate validity, as shown in Table 4, the HTMT ranged from 0.59 to 0.78, all below 0.85 that showed the new four-factor structure found in this study with good discriminate validity.
Fit indices for configural invariance indicated that our newly developed four-factor structure of latent variables is invariant across clinical and non-clinical samples, thus establishing our baseline model. CFI and RMSEA differentials between the configural model and metric model were all < 0.01, affirming metric invariance across the clinical and non-clinical samples. Scalar invariance was also established based on meeting the mutative index criteria. Lastly, strict invariance was established based on our obtained ΔCFI and ΔRMSEA values being < 0.01. The data obtained in our measurement invariance analyses across clinical and non-clinical samples, from configural invariance to strict invariance, are reported in Table 5.
As shown in Table 6, partial scalar invariance across sex was obtained in a non-clinical sample (Samples 1 + 2) under the condition that permitting free intercept estimations of items 2, 9, 11, and 18, based on modification indices. CFA of the new four-factor structure indicated a slight insufficiency in Sample 2; thus, freely estimated error covariance between items 2 and 4 was permitted when conducting measurement invariance across sex in the non-clinical sample. In the clinical sample (Sample 3), full measurement invariance analysis yielded ΔCFIs < 0.01 and ΔRMSEAs < 0.001 between increasingly constrained models.
In the current study, a newly established four-factor structure was affirmed as the most suitable factor structure for a Chinese version of the 18-item TEPS in both clinical and non-clinical samples. In this four-factor structure, anticipatory pleasure and consummatory pleasure factors were each subdivided based on a motivation dimension. Measurement invariance analysis across clinical and non-clinical samples achieved strict invariance. Measurement invariance analysis across sex obtained strict invariance in the clinical sample and partial scalar invariance in the non-clinical sample.
In line with previous research, the TEPS was demonstrated to be a reliable, stable tool for assessing anhedonia in this study, with a Cronbach’α and McDonald’s omega > 0.80 and a retest coefficient of 0.70 [15, 24]. Furthermore, this study confirmed that the 18-item TEPS can be used to assess consummatory pleasure and anticipatory pleasure separately in Chinese respondents [15, 22]. Although item 11 and item 12 were transferred from anticipatory pleasure to consummatory pleasure in this study, the contents of these items contain a definite time and location, probing the ability of people to feel pleasure before anticipatory events have occurred. For example, item 11 (When I’m on my way to an amusement park, I can hardly wait to ride the roller coasters) suggests that being route to an amusement park can be enough to make someone feel pleasure. Consistent with previous research, we found that item 7 had low factor loading and thus decided to omit it in our CFA [19, 24]. A prior TEPS study in China also reported that item 7 had weak relations to others items and argued that there may be a cultural divergence in the interpretation of item 7 .
The consummatory-anticipatory division of anhedonia has gained substantial empirical evidence in animal studies as well as in human neurophysiological and behavioral studies [12, 56, 57]. There appears to be dissociable neural substrates mediating consummatory pleasure and anticipatory pleasure, with the former having been related to opioid neurotransmission onto GABAergic spiny neurons in the nucleus accumbens and the latter being related to mesolimbic dopaminergic neurotransmission . Parsing anhedonia into finer components will benefit our understanding of the role of specific neurotransmitters and neural systems in mediating the psychological phenomenon of anhedonia. In addition, the full measurement invariance affirmed here across sex groups as well as across clinical versus non-clinical samples supports the view that the TEPS can be considered a stable assessment tool for the evaluation of consummatory pleasure and anticipatory pleasure. Furthermore, our comparison of goodness-of-fit indices among the initial two-factor structure of the TEPS , a previously published four-factor structure for a Chinese version of the TEPS with two added items , and the presently introduced four-factor structure that was newly developed through CFA indicates that our newly developed four-factor structure provides an improved factor structure in both non-clinical and clinical samples.
Regarding our division between with and without motivation-driven dimensions of consummatory and anticipatory pleasure, the role of motivation in anhedonia may involve value and effort computation for goal-directed behaviors, which are key in reward processing [17, 58]. Regarding motivation deficits related to anhedonia, someone who does not enjoy a typically rewarding activity due to anhedonia would be expected to lack motivation to pursue that activity in the future . In turn, an individual with motivation deficits may experience less pleasure, favoring a vicious cycle between a motivation deficit and anhedonia. For example, compared to healthy controls, people with MDD tend to choose lower effort-expenditure rewarding tasks and expend less effort in a progressive ratio task . Similarly, people with schizophrenia have been found to also tend to favor lower effort-expenditure rewarding tasks than controls, and their anhedonia symptoms have been shown to correlate with motivation deficit magnitude [61, 62]. Hence, it is important to have a scale that can be used to assess motivation in the context of anhedonia, and the presently developed four-factor structure of the TEPS suggests that the TEPS has the potential to be used in such an application.
The first factor identified, namely anticipatory pleasure with motivation-driving, reflects the need for approach motivation to achieve anticipated events, including making plans and anticipating effort (e.g., item 14, When I think of something tasty, like a chocolate chip cookie, I have to have one). Conversely, the second factor, anticipatory pleasure without motivation-driving, encompasses anticipatory events but with a limited need for motivation or an affirmative attitude (e.g., item 15, Looking forward to a pleasurable experience is in itself pleasurable). Meanwhile, the third factor, consummatory pleasure with motivation-driving, refers to pleasurable experiences in which one must be motivated to actively remember a pleasure to activate and maintain a representation (e.g., item 9, I love it when people play with my hair). Lastly, the fourth factor, consummatory pleasure without motivation-driving, refers to immediately accessible enjoyment without a need to desire more. Constituent items of this fourth factor tend to refer to natural events involving limited subjective initiative (e.g., item 13, I appreciate the beauty of a fresh snowfall).
The motivation dimension affirmed in our analyses was found to exist for both consummatory pleasure and anticipatory pleasure, a supposition that is supported by previous empirical evidence. For example, consummatory and anticipatory pleasure were found to be related to motivation-associatedevent-related potential signals in a study employing a cue gambling task . Meanwhile, significantly impaired consummatory and anticipatory pleasure in schizophrenia may only emerge in the context of a serious motivation deficit . Hence, the consideration of motivation in the factor structure of the TEPS may provide new insight enabling a more comprehensive understanding of the TEPS, thus expanding the applicability of the TEPS in relation to a more detailed structural understanding of anhedonia.
The newly explored four-factor structure showed good convergent validity and discriminate validity. Previous studies mainly focused on the initial two-factor structure’s convergent and discriminate validity through correlation analysis. In the initial study, Grad et al. demonstrated that the two-factor structure have good convergent validity and discriminate validity. The result of correlation analysis indicated that both anticipatory pleasure factor and consummatory pleasure factor significantly correlated with other scales measuring anhedonia and showed separation correlation patterns as well . Subsequently, Paul et al. not only demonstrated that the two-factor structure have good convergent validity and discriminate validity, but also indicated that TEPS can possibly assess motivation components of anhedonia . Although prior studies only demonstrated that the two-factor structure showed good convergent validity and discriminate validity, this study also showed that the newly explored four-factor structure has good convergent validity and discriminate validity through CR and HTMT indexes.
The present findings of full measurement invariance (configural, metric, scalar, and error variance) for our newly explored four-factor structure across clinical and non-clinical samples indicate that differences in TEPS performance between the clinical and non-clinical respondents can be interpreted reliably. This affirmation is important given that TEPS scores have been reported to differ between clinical and non-clinical groups and appear to be differentially affected across clinical groups (e.g. impaired anticipatory pleasure and consummatory pleasure in MDD , but bias toward impairment in anticipatory pleasure in schizophrenia [20, 29,30,31]). Furthermore, recent studies employing reward task-choice behavioral analyses have suggested that there may be distinct clinically important motivation impairments in relation to anhedonia in patients with schizophrenia, bipolar disorder, and MDD [65, 66]. Hence, measurement invariance provides confidence that TEPS score differences reflect authentic differences across the well-establishedanticipatory-consummatory pleasure dimension as well as across a newly exposed motivation-nonmotivation dimension in future research.
With respect to measurement invariance across sex in a non-clinical sample, based on modification indices, we permitted correlations of the error variance between item 2 (The sound of crackling wood in the fireplace is very relaxing) and item 4 (I love the sound of rain on the windows when I’m lying in my warm bed). These two items both contribute to the consummatory pleasure without motivation-driving subscale and reflect pleasure related to a natural phenomenon, which may be related to a residual correlation between them. The intercepts of items 2, 9, 11, and 18 were free estimated when we conducted scalar invariance analysis, indicating that researchers should further test whether these items perform differently in relation to sex in a non-clinical sample. Similarly, Zhou et al. also reported partial scalar invariance across sex in an undergraduate sample employing a 20-item version of the TEPS . Notwithstanding, the full measurement invariance observed across sex in our clinical sample may be more important in the context of exploring the mechanisms of anhedonia. With respect to sex differences in anhedonia [34, 35], some researchers have reported that men are more likely to experience anhedonia than women . Indeed, a meta-analysis indicated that, compared to females, males with schizophrenia spectrum disorders report lower anticipatory pleasure and consummatory pleasure, as measured by the TEPS . Overall, affirmation of measurement invariance provides a premise for probing differences in anhedonia pattern between males and females.
Some limitations of this study should be noted. First, because this study was conducted in a Chinese cultural context, the generalizability of the findings to other cultural contexts remains to be determined. Using a 20-item version of the TEPS in China, Chan et al. did find full measurement invariance for consummatory pleasure and anticipatory pleasure subscales across cultures, which may offset this limitation to some . Second, our enrollment of college students as a non-clinical sample may restrict the generalizability of our findings to other age ranges. With respect to age generalization, however, prior studies examining the TEPS in community samples have affirmed its stability across age bands [21, 23]. Third, the cut-off points of indices used for CFA and TLI may be too lax for the assessment of the goodness of fit in this study, as recently some researchers proposed considered values over .95 for CFI and TLI and below .08 for SRMR and .06 for RMSEA , or values above .95 or .97 for CFI and TLI paired with values lower than .05 for SRMR and RMSEA as representative of a good fit with data . Even Sivo et al. considered sample size to establish cut-off points , which means that depending on the sample size of this study, values higher than .99 for CFI and TLI accompanied by values lower than .05 and below .03 for RMSEA are indicative of a good fit to data. However, it also should be noticed that the fit indices of new four-factor found in this study achieved traditional criteria of the goodness of fit, and better than others two models. Lastly, as Fan and Sivo suggested, the Δgoodness-of-fit indexes are designed to assess model fit in terms of covariance structure and may be sensitive to model size , which should be considered especially when mean structure invariance is the research focus.
For the first time, this study determined the most suitable factor structure for a Chinese version of the 18-item TEPS with multiple methods and further confirmed the resultant four-factor structure in clinical and non-clinical samples. Besides, the newly four-factor structure was demonstrated with good convergent validity and discriminate validity. Full measurement invariance was observed between clinical and non-clinical samples and between sex in a clinical sample. Partial scalar invariance was found across sex in a non-clinical sample. The present results provide insights into the psychometric properties of the TEPS as well as the psychological phenomenon of anhedonia.
Availability of data and materials
The datasets generated and analyzed during the current study are not publicly available due to no permission from participants to share anonymized participant data publicly but are available from the corresponding author on reasonable request.
This study got permission from the original creators of the TEPS to use and translate their work in this way.
the Temporal experience of Pleasure Scale
exploratory factor analysis
confirmatory factor analysis
mean inter-item correlation
Velicer’s minimum average partial
maximum likelihood with robust standards errors
- X2 :
degrees of freedom
comparative fit index
root mean square error of approximation
Ribot T. La psychologie des sentiments: Félix Alcan; 1917.
Pizzagalli DA, Iosifescu D, Hallett LA, Ratner KG, Fava M. Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task. J Psychiatr Res. 2008;43(1):76–87. https://doi.org/10.1016/j.jpsychires.2008.03.001.
Keedwell PA, Andrew C, Williams SCR, Brammer MJ, Phillips ML. The neural correlates of anhedonia in major depressive disorder. Biol Psychiatry. 2005;58(11):843–53. https://doi.org/10.1016/j.biopsych.2005.05.019.
Andreasen NC. Negative symptoms in schizophrenia. Definition and reliability. Arch Gen Psychiatry. 1982;39(7):784–8. https://doi.org/10.1001/archpsyc.1982.04290070020005.
Vaquero-Puyuelo D, De-la-Camara C, Olaya B, Gracia-Garcia P, Lobo A, Lopez-Anton R, et al. Anhedonia as a potential risk factor of Alzheimer's disease in a community-dwelling elderly sample: results from the ZARADEMP project. Int J Environ Res Public Health. 2021;18(4):12. https://doi.org/10.3390/ijerph18041370.
Fawcett J, Clark DC, Scheftner WA, Gibbons RD. Assessing anhedonia in psychiatric patients. Arch Gen Psychiatry. 1983;40(1):79–84. https://doi.org/10.1001/archpsyc.1983.01790010081010.
Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P. A scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale. Br J Psychiatry. 1995;167(1):99–103. https://doi.org/10.1192/bjp.167.1.99.
Ho N, Sommers M. Anhedonia: a concept analysis. Arch Psychiatr Nurs. 2013;27(3):121–9. https://doi.org/10.1016/j.apnu.2013.02.001.
Olino TM, McMakin DL, Forbes EE. Toward an empirical multidimensional structure of Anhedonia, reward sensitivity, and positive emotionality: an exploratory factor analytic study. Assessment. 2018;25(6):679–90. https://doi.org/10.1177/1073191116680291.
Chapman LJ, Chapman JP, Raulin ML. Scales for physical and social anhedonia. J Abnorm Psychol. 1976;85(4):374–82. https://doi.org/10.1037/0021-843x.85.4.374.
Strauss GP, Gold JM. A new perspective on Anhedonia in schizophrenia. Am J Psychiatr. 2012;169(4):364–73. https://doi.org/10.1176/appi.ajp.2011.11030447.
Berridge KC, Robinson TE. Parsing reward. Trends Neurosci. 2003;26(9):507–13. https://doi.org/10.1016/s0166-2236(03)00233-9.
Berridge KC, Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev. 1998;28(3):309–69. https://doi.org/10.1016/s0165-0173(98)00019-8.
Berridge KC, Robinson TE, Aldridge JW. Dissecting components of reward: ‘liking’, ‘wanting’, and learning. Curr Opin Pharmacol. 2009;9(1):65–73. https://doi.org/10.1016/j.coph.2008.12.014.
Gard DE, Gard MG, Kring AM, John OP. Anticipatory and consummatory components of the experience of pleasure: a scale development study. J Res Pers. 2006;40(6):1086–102. https://doi.org/10.1016/j.jrp.2005.11.001.
Kring AM, Barch DM. The motivation and pleasure dimension of negative symptoms: neural substrates and behavioral outputs. Eur Neuropsychopharmacol. 2014;24(5):725–36. https://doi.org/10.1016/j.euroneuro.2013.06.007.
Wallis JD. Orbitofrontal cortex and its contribution to decision-making. Annu Rev Neurosci. 2007;30(1):31–56. https://doi.org/10.1146/annurev.neuro.30.051606.094334.
Llerena K, Park SG, McCarthy JM, Couture SM, Bennett ME, Blanchard JJ. The motivation and pleasure scale-self-report (MAP-SR): reliability and validity of a self-report measure of negative symptoms. Compr Psychiatry. 2013;54(5):568–74. https://doi.org/10.1016/j.comppsych.2012.12.001.
Ho PM, Cooper AJ, Hall PJ, Smillie LD. Factor structure and construct validity of the temporal experience of pleasure scales. J Pers Assess. 2015;97(2):200–8. https://doi.org/10.1080/00223891.2014.940625.
Gard DE, Kring AM, Gard MG, Horan WP, Green MF. Anhedonia in schizophrenia: distinctions between anticipatory and consummatory pleasure. Schizophr Res. 2007;93(1-3):253–60. https://doi.org/10.1016/j.schres.2007.03.008.
Favrod J, Ernst F, Giuliani F, Bonsack C. Validation of the temporal experience of pleasure scale (TEPS) in a French-speaking environment. Encephale-Revue De Psychiatrie Clinique Biologique Et Therapeutique. 2009;35(3):241–8. https://doi.org/10.1016/j.encep.2008.02.013.
Loas G, Monestes JL, Ameller A, Bubrovszky M, Yon V, Wallier J, et al. Psychometric properties of the French version of the temporal experience of pleasure scale (TEPS): study on 125 university students and on 162 psychiatric subjects. Annales Medico-Psychologiques. 2009;167(9):641–8. https://doi.org/10.1016/j.amp.2009.09.002.
Simon JJ, Zimmermann J, Cordeiro SA, Maree I, Gard DE, Friederich HC, et al. Psychometric evaluation of the temporal experience of pleasure scale (TEPS) in a German sample. Psychiatry Res. 2018;260:138–43. https://doi.org/10.1016/j.psychres.2017.11.060.
Chan RCK, Y-f S, M-k L, Wang Y-n, Wang Y, Kring AM. The temporal experience of pleasure scale (TEPS): exploration and confirmation of factor structure in a healthy Chinese sample. PLoS One. 2012;7(4):e35352. https://doi.org/10.1371/journal.pone.0035352.
Stratta P, Pacifico R, Riccardi I, Daneluzzo E, Rossi A. Anticipatory and consummatory pleasure: validation study of the italian version of the temporal experience of pleasure scale. Ital J Psychopathol. 2011;17:322–7.
Alavi K, Asghari MM, Rahiminezhad A, Farahani H. Psychometric properties of the Persian version of temporal experience of pleasure scale (TEPS) in university students; 2018.
Zhou H, Liu WT, Fan J, Xia J, Zhu J, Zhu XZ. The temporal experience of pleasure scale (TEPS): measurement invariance across gender in Chinese University students. Front Psychol. 2019;10. https://doi.org/10.3389/fpsyg.2019.02130.
Garfield JBB, Cotton SM, Lubman DI. Psychometric properties, validity, and reliability of the temporal experience of pleasure scale state version in an opioid-dependent sample. Drug Alcohol Depend. 2016;161:238–46. https://doi.org/10.1016/j.drugalcdep.2016.02.011.
Mote J, Minzenberg MJ, Carter CS, Kring AM. Deficits in anticipatory but not consummatory pleasure in people with recent-onset schizophrenia spectrum disorders. Schizophr Res. 2014;159(1):76–9. https://doi.org/10.1016/j.schres.2014.07.048.
Visser KF, Chapman HC, Ruiz I, Raugh IM, Strauss GP. A meta-analysis of self-reported anticipatory and consummatory pleasure in the schizophrenia-spectrum. J Psychiatr Res. 2020;121:68–81. https://doi.org/10.1016/j.jpsychires.2019.11.007.
Li S, Zhang Y, Fan J, Liu W, Gan J, He J, et al. Patients with obsessive-compulsive disorder exhibit deficits in Consummatory but not anticipatory pleasure. Front Psychol. 2019;10. https://doi.org/10.3389/fpsyg.2019.01196.
Li YH, Mou XD, Jiang WH, Yang Z, Shen XH, Jin ZM, et al. A comparative study of anhedonia components between major depression and schizophrenia in Chinese populations. Ann General Psychiatry. 2015;14(1):24. https://doi.org/10.1186/s12991-015-0061-3.
Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ Res Methods. 2000;3(1):4–70. https://doi.org/10.1177/109442810031002.
Miller LS, Burns SA. Gender differences in schizotypic features in a large sample of young adults. J Nerv Ment Dis. 1995;183(10):657–61. https://doi.org/10.1097/00005053-199510000-00007.
Albertella L, Le Pelley ME, Copeland J. Cannabis use in early adolescence is associated with higher negative schizotypy in females. Eur Psychiatr. 2017;45:235–41. https://doi.org/10.1016/j.eurpsy.2017.07.009.
Gregoire J. ITC Guidelines for Translating and Adapting Tests (Second Edition). Int J Test. 2018;18:101–34. https://doi.org/10.1080/15305058.2017.1398166.
Henson RK. Understanding internal consistency reliability estimates: a conceptual primer on coefficient alpha. Meas Eval Couns Dev. 2001;34(3):177–89. https://doi.org/10.1080/07481756.2002.12069034.
Briggs SR, Cheek JM. The role of factor analysis in the development and evaluation of personality scales. J Pers. 1986;54(1):106–48. https://doi.org/10.1111/j.1467-6494.1986.tb00391.x.
Dunn TJ, Baguley T, Brunsden V. From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br J Psychol. 2014;105(3):399–412. https://doi.org/10.1111/bjop.12046.
Guttman L. A basis for analyzing test-retest reliability. Psychometrika. 1945;10(4):255–82. https://doi.org/10.1007/BF02288892.
Taherdoost H, Sahibuddin S, Jalaliyoon N. "Exploratory Factor Analysis; Concepts and Theory." Post-Print (2014).
Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960;20(1):141–51. https://doi.org/10.1177/001316446002000116.
Muthén L, Muthén B. "Mplus user's guide (7th ed.)." (2012).
Reise SP, Waller NG, Comrey AL. Factor analysis and scale revision. Psychol Assess. 2000;12(3):287–97. https://doi.org/10.1037//1040-3522.214.171.1247.
Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30(2):179–85. https://doi.org/10.1007/bf02289447.
Zwick WR, Velicer WF. Comparison of five rules for determining the number of components to retain. Psychol Bull. 1986;99(3):432–42. https://doi.org/10.1037/0033-2909.99.3.432.
O'Connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behav Res Methods Instrum Comput. 2000;32(3):396–402. https://doi.org/10.3758/bf03200807.
Maydeu-Olivares A. Maximum likelihood estimation of structural equation models for continuous data: standard errors and goodness of fit. Struct Equ Model Multidiscip J. 2017;24(3):383–94. https://doi.org/10.1080/10705511.2016.1269606.
Hu L-t, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.
Marsh HW, Hau K-T, Wen Z. In search of Golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Model Multidiscip J. 2004;11(3):320–41. https://doi.org/10.1207/s15328007sem1103_2.
Chen F, Curran PJ, Bollen KA, Kirby J, Paxton P. An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociol Methods Res. 2008;36(4):462–94. https://doi.org/10.1177/0049124108314720.
Nunnally JC. Psychometric theory: Tata McGraw-hill education; 1994.
Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43(1):115–35. https://doi.org/10.1007/s11747-014-0403-8.
Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model Multidiscip J. 2002;9(2):233–55. https://doi.org/10.1207/s15328007sem0902_5.
Meade AW, Johnson EC, Braddy PW. Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol. 2008;93(3):568–92. https://doi.org/10.1037/0021-9010.93.3.568.
Knutson B, Adams CM, Fong GW, Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci. 2001;21:RC159. https://doi.org/10.1523/JNEUROSCI.21-16-j0002.2001.
Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, et al. Choice selection and reward anticipation: an fMRI study. Neuropsychologia. 2004;42(12):1585–97. https://doi.org/10.1016/j.neuropsychologia.2004.05.011.
Barch DM, Dowd EC. Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr Bull. 2010;36(5):919–34. https://doi.org/10.1093/schbul/sbq068.
Der-Avakian A, Pizzagalli DA. Translational assessments of reward and Anhedonia: a tribute to Athina Markou. Biol Psychiatry. 2018;83(11):932–9. https://doi.org/10.1016/j.biopsych.2018.02.008.
Treadway MT, Bossaller NA, Shelton RC, Zald DH. Effort-based decision-making in major depressive disorder: a translational model of motivational Anhedonia. J Abnorm Psychol. 2012;121(3):553–8. https://doi.org/10.1037/a0028813.
Treadway MT, Peterman JS, Zald DH, Park S. Impaired effort allocation in patients with schizophrenia. Schizophr Res. 2015;161(2-3):382–5. https://doi.org/10.1016/j.schres.2014.11.024.
McCarthy JM, Treadway MT, Bennett ME, Blanchard JJ. Inefficient effort allocation and negative symptoms in individuals with schizophrenia. Schizophr Res. 2016;170(2-3):278–84. https://doi.org/10.1016/j.schres.2015.12.017.
Chen Y, Xu J, Zhou L, Zheng Y. The time course of incentive processing in anticipatory and consummatory anhedonia. J Affect Disord. 2018;238:442–50. https://doi.org/10.1016/j.jad.2018.05.053.
Da Silva S, Saperia S, Siddiqui I, Fervaha G, Agid O, Daskalakis ZJ, et al. Investigating consummatory and anticipatory pleasure across motivation deficits in schizophrenia and healthy controls. Psychiatry Res. 2017;254:112–7. https://doi.org/10.1016/j.psychres.2017.04.040.
Zou Y-M, Ni K, Wang Y-Y, Yu E-Q, Lui SSY, Zhou F-C, et al. Effort-cost computation in a transdiagnostic psychiatric sample: differences among patients with schizophrenia, bipolar disorder, and major depressive disorder. Psych J. 2020;9(2):210–22. https://doi.org/10.1002/pchj.316.
Wang JA, Huang J, Yang XH, Lui SSY, Cheung EFC, Chan RCK. Anhedonia in schizophrenia: deficits in both motivation and hedonic capacity. Schizophr Res. 2015;168(1-2):465–74. https://doi.org/10.1016/j.schres.2015.06.019.
Powers JM, Carroll AJ, Veluz-Wilkins AK, Blazekovic S, Gariti P, Leone FT, et al. Is the effect of Anhedonia on smoking cessation greater for women versus men? Nicotine Tob Res. 2017;19(1):119–23. https://doi.org/10.1093/ntr/ntw148.
Li Z, Shi HS, Elis O, Yang ZY, Wang Y, Lui SSY, et al. The structural invariance of the temporal experience of pleasure scale across time and culture. Psych J. 2018;7(2):59–67. https://doi.org/10.1002/pchj.207.
Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Mpr Online. 2003;8:23–74.
Sivo SA, Fan XT, Witta EL, Willse JT. The search for "optimal" cutoff properties: fit index criteria in structural equation modeling. J Exp Educ. 2006;74(3):267–88. https://doi.org/10.3200/jexe.74.3.267-288.
Fan XT, Sivo SA. Using goodness-of-fit indexes in assessing mean structure invariance. Struct Equ Model Multidiscip J. 2009;16(1):54–69. https://doi.org/10.1080/10705510802561311.
Thanks to all of people who provide help to this study, for those contributions helped this study completed more smoothly.
This study was supported by Chinese Ministry of Education’s Humanities and Social Science Research Project (Grant No. 13YJA190015) in the design of the study. This study was also supported by National Natural Science Foundation of China (Grant No. 31671144) and Research Foundation of the Education Commission of Hunan Province (Grant No. 2017jy77), in the data collection. Besides, this study was supported by the Hunan Provincial Natural Science Foundation of China (Grant No. 2019JJ40362), the Fundamental Research Funds for the Central Universities of Central South University (grant No. 2020zzts284) in the analysis and interpretation of data and in writing the manuscript.
Ethics approval and consent to participate
The study protocol was approved by the Ethics Committee of the Second Xiangya Hospital of Central South University. All participants provided written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Fang, S., Huang, X., Zhang, P. et al. Factor structure and sex invariance of the temporal experience of pleasure scale (TEPS) in Chinese university students and clinical population. BMC Psychiatry 21, 378 (2021). https://doi.org/10.1186/s12888-021-03379-9
- Psychometric properties
- Exploratory factor analysis
- Confirmatory factor structure