Table 1 Inter-rater variability: Expectation of stakeholders. ‘Maximum acceptable difference’ in work capacity (WC) ratings between two experts performing a psychiatric evaluation in the same patient [6]
What is the maximum difference in WC ratings that stakeholders would find acceptable when two experts independently assess the same patient? | Lawyers (n = 81) | Psychiatrists (n = 242) | Experts (n = 114) | Judges (n = 47) | Insurers (n = 108) |
|---|---|---|---|---|---|
… in the current situation of performing evaluations, median difference (interquartile range, IQR) | 15% (10–20%) | 20% (10–25%) | 20% (10–25%) | 15% (10–20%) | 10% (10–20%) |