Skip to main content

Table 2 Average score and inter-rater reliability per item of the ART monitor (N = 15)

From: The Active Recovery Triad monitor: evaluation of a model fidelity scale for recovery-oriented care in long-term mental health care settings

Item

Average score (SD)

Exact Agreement

Agreement allowing 1-point difference

Team structure

1. Caseloada

3.27 (1.64)

66.7%

-

2. Team composition

2.77 (1.14)

26.7%

86.7%

3. Peer worker and family peer worker

1.37 (0.67)

80.0%

100.0%

4. Nurses

3.87 (1.14)

53.3%

66.7%

5. Nurse practitioner

2.70 (1.66)

53.3%

86.7%

6. Social workers/residential support worker

3.27 (1.80)

73.3%

100.0%

7. Occupational therapist

1.37 (0.77)

86.7%

93.3%

8. Psychiatristb

3.87 (1.39)

73.3%

100.0%

9. Health care psychologist/behavioral specialist

2.97 (1.85)

73.3%

80.0%

10. Extra disciplines

3.17 (1.05)

53.3%

100.0%

Team process

11. Vision and working methoda

2.53 (1.01)

66.7%

-

12. Community participation

2.27 (1.08)

33.3%

86.7%

13. Hospitality and presence

3.43 (0.73)

46.7%

93.3%

14. Attitude of staff

2.60 (0.81)

60.0%

86.7%

15. Active recoverya

2.53 (0.86)

66.7%

-

16. Working in the triada

3.07 (0.37)

93.3%

-

Recovery-oriented care and support

17. Intake

2.23 (0.84)

26.7%

73.3%

18. Care coordination meeting (CCM)

2.40 (1.19)

46.7%

86.7%

19. Revitalize or build resource group

2.33 (0.84)

33.3%

73.3%

20. Introduce recoverya

2.67 (1.06)

66.7%

-

21. Needs, strengths, and wishes

2.73 (1.02)

46.7%

80.0%

22. Integrated treatment and recovery plan

3.00 (0.91)

26.7%

80.0%

23. Recovery interventions at four levelsa

2.40 (1.30)

80.0%

-

24. Systematic risk assessment

2.07 (1.11)

20.0%

80.0%

25. Early warning sign plana

3.03 (1.13)

46.7%

-

26. Digital whiteboard

1.77 (1.31)

80.0%

93.3%

27. Rooming ina

2.20 (1.13)

73.3%

-

28. Stepped care

2.87 (1.07)

33.3%

86.7%

29. Recovery assessmenta

2.13 (1.36)

66.7%

-

Other principles of recovery-oriented care and support

30. Mental health care standards

2.37 (0.81)

46.7%

73.3%

31. Somatic carea

3.87 (1.14)

53.3%

-

32. Medication policy

3.80 (0.81)

20.0%

86.7%

33. Dual diagnosis

1.73 (0.91)

60.0%

80.0%

Organization of care

34. Cooperation with FACT and other outpatient care teamsa

1.27 (0.87)

80.0%

-

35. Admission and discharge

2.37 (1.19)

40.0%

73.3%

36. Care process and consultation

2.27 (1.53)

73.3%

80.0%

37. Waiting list

2.47 (1.50)

53.3%

80.0%

38. Reachability

4.03 (1.19)

26.7%

73.3%

39. Regional teamsa

1.63 (0.93)

73.3%

-

40. ART-improvement curve

2.17 (1.44)

60.0%

80.0%

Professionalization

41. Reflectiona

2.13 (1.46)

66.7%

-

42. Training and education

2.13 (0.86)

26.7%

60.0%

43. Knowledge of regional networka

2.60 (1.22)

66.7%

-

44. Team spirit

3.40 (0.93)

46.7%

86.7%

Healing environment

45. Healthy living environment

1.93 (1.02)

53.3%

93.3%

46. Housing firsta

1.77 (1.28)

46.7%

-

47. Housing conditions

2.63 (1.00)

26.7%

80.0%

Safety

48. Safety management system

4.47 (0.73)

60.0%

86.7%

49. Conflict management and personal safetya

4.20 (1.35)

60.0%

-

50. Cooperation agreements on safety

3.23 (1.38)

40.0%

80.0%

Reduction of coercion

51. Evaluation of coercive measures

3.03 (1.50)

33.3%

53.3%

  1. aitem with scoring options 1, 3, and 5
  2. bitem with scoring options 1, 2, 4, and 5