Attachment K - InterRater Reliability Criteria.pdf
PDF 138 KB Posted
- Attached to
- MLRM External Clinical Review BPA
- Solicitation number
- 36C10X24R0038
About this file
This document is the Inter-Rater Reliability (IRR) Criteria attachment for a federal contract opportunity. The key details are:
The IRR study criteria include: 1) Involving all panel members, 2) Establishing time frames, 3) Defining passing, failing, and remediation benchmarks, 4) Outlining the remediation process, 5) Specifying when reassessments will occur for reviewers who do not pass, and 6) Determining when a provider will be removed from the panel.
The example IRR study methodology uses a point system where reviewers earn points for discordances and inappropriate reviews. If a reviewer earns 2 marks from the Medical Director's disagreement, they fail the IRR and require remediation. After 2 failed remediations within 12 months, the reviewer may be removed from the panel.
This IRR criteria is associated with Solicitation #36C10X24R0038 for the MLRM External Clinical Review BPA issued by the Department of Veterans Affairs. The BPA will have a 5-year performance period and requires providers to conduct peer reviews, management reviews, medical advisory opinions, and IRR studies.
View the file
Other files
Show all 27
On GovTribe
Work with this file
- Download the original file
- Contacts named in this file
- Similar government files
- Ask GovTribe AI about this file
Text version
Criteria for Inter‐Rater Reliability (IRR) Study
1) Include all panel members
2) Will include time frames.
3) Including what benchmarks are:
a. Passing
b. Failing
c. Require Remediation
4) What constitutes remediation
5) When will reassessments occur for those reviewers that do not pass the IRR
6) When will a provider be removed from the panel
Potential Example of Study
This method is continuous. A Point system is implemented for each reviewer. A point is earned by a reviewer for:
1) Each 2 Level discordance (PRC level 1: Reviewer level 3 or PRC level 3; Reviewer level 1)
2) Each Facility/VISN/VACO concern of inappropriate review
When 3 points are earned, VENDOR Medical Director will assess those cases. If the Medical Director agrees with the reviewer, 0 marks given. If the Medical Direct disagrees with the reviewer’s assessment
1 mark is given. If there are 2 marks, the reviewer has failed the IRR, and will need remediation.
Reassessment will occur each time 3 points are earned by a reviewer. If a reviewer is remediated 2 times within a rolling 12 months, that reviewer will be considered for removal from the panel.
Attachment K: Inter-Rater Reliability Criteria
File details come from the government source that posted it. Updated .