The development and validation of a medicines optimisation tool to protect the physical health of people with severe mental illness (OPTIMISE)

Table 4 Interrater reliability of OPTIMISE criteria between 4 healthcare professionals across 20 datasets

Rater Combination	A	B	C	D	Ppos	Pneg	Kappa (95% CI)
Standard * rater 1	155	42	91	1012	0.70	0.94	0.639 (0.583 to 0.695)
Standard * rater 2	229	33	28	1010	0.88	0.97	0.848 (0.811 to 0.885)
Standard * rater 3	202	39	44	1015	0.83	0.96	0.790 (0.747 to 0.834)
Standard * rater 4	226	35	20	1019	0.89	0.97	0.865 (0.831 to 0.900)
Standard* raters 1,2,3,4	-	-	-	-	-	-	0.752 (0.717 to 0.782)

A, frequency that both the standard and rater agreed criterion applied; B, standard scored criterion not applied, rater scored criterion applied; C, standard scored criterion applied, rater scored criterion not applied; D, both standard and rater agreed criterion not applied; ppos, proportion of positive agreement; pneg, proportion of negative agreement; CI, confidence interval; IQR, interquartile range

ISSN: 1471-244X