Skip to main content

Advertisement

Springer Nature is making Coronavirus research free. View research | View latest news | Sign up for updates

Table 1 Inter-rater variability: Expectation of stakeholders. ‘Maximum acceptable difference’ in work capacity (WC) ratings between two experts performing a psychiatric evaluation in the same patient [6]

From: The reproducibility of psychiatric evaluations of work disability: two reliability and agreement studies

What is the maximum difference in WC ratings that stakeholders would find acceptable when two experts independently assess the same patient? Lawyers
(n = 81)
Psychiatrists
(n = 242)
Experts
(n = 114)
Judges
(n = 47)
Insurers
(n = 108)
… in the current situation of performing evaluations, median difference (interquartile range, IQR) 15%
(10–20%)
20%
(10–25%)
20%
(10–25%)
15%
(10–20%)
10%
(10–20%)
  1. Legend: WC: work capacity; % WC = absolute percentage points in work capacity
  2. How to interpret this table?
  3. • 75% of treating and expert psychiatrists felt that the ‘maximum acceptable difference’ in WC ratings between two experts should be 25% corresponding to the upper limit of the IQR
  4. • 75% of lawyers, judges and insurers and 50% of treating and expert psychiatrists felt that the ‘maximum acceptable difference’ in WC ratings between two experts should be 20% WC corresponding to the upper limit of the IQR (jurists) or the median (psychiatrists)
  5. • 50% of lawyers, judges and insurers felt that the ‘maximum acceptable difference’ in WC ratings between two experts should be 15% corresponding to the median
  6. • 25% of all stakeholders felt that the ‘maximum acceptable difference’ in WC ratings between two experts should be 10% corresponding to the lower limit of the IQR