Skip to main content

Table 4 Interrater reliability of OPTIMISE criteria between 4 healthcare professionals across 20 datasets

From: The development and validation of a medicines optimisation tool to protect the physical health of people with severe mental illness (OPTIMISE)

Rater Combination A B C D Ppos Pneg Kappa (95% CI)
Standard * rater 1 155 42 91 1012 0.70 0.94 0.639 (0.583 to 0.695)
Standard * rater 2 229 33 28 1010 0.88 0.97 0.848 (0.811 to 0.885)
Standard * rater 3 202 39 44 1015 0.83 0.96 0.790 (0.747 to 0.834)
Standard * rater 4 226 35 20 1019 0.89 0.97 0.865 (0.831 to 0.900)
Standard* raters 1,2,3,4 - - - - - - 0.752 (0.717 to 0.782)
  1. A, frequency that both the standard and rater agreed criterion applied; B, standard scored criterion not applied, rater scored criterion applied; C, standard scored criterion applied, rater scored criterion not applied; D, both standard and rater agreed criterion not applied; ppos, proportion of positive agreement; pneg, proportion of negative agreement; CI, confidence interval; IQR, interquartile range