Peer Review Starts With Strategy, Not Sample Size
It's Not Just How Many Cases. It's Which Ones.
The first question organizations ask about peer review is almost always, “How many cases should we submit for peer review?” It’s also one of the least important. Case count matters when conducting peer review, but it’s a downstream decision. Before deciding how many cases should be reviewed, leadership needs to clearly define the purpose of the review and what it needs to accomplish. Until that is identified, there is no meaningful way to determine the appropriate sample size. Sometimes one case is enough. Other times, 30 cases aren’t nearly sufficient.
Effective peer review starts with strategy, not statistics.
These three questions deserve real answers before external peer review is considered:
- What prompted the review?
- What questions are you trying to answer?
- What will you do with the findings?
What Prompted Peer Review?
Start by clearly identifying the trigger for external review. Was there a red flag? Is the concern tied to a single case, a broader pattern, one or more complaints, new privileges, or contract performance? The varying responses point towards different kinds of review:
- A concern isolated to one adverse outcome usually calls for submitting that single case for focused review.
- A concern about an aberrant pattern, say, an outlier complication rate or a cluster of similar complaints, calls for a larger, carefully selected set of cases built around the specific pattern in question. This kind of pattern review often overlaps with wRVU outlier productivity review findings, since both start from a statistical outlier.
- A concern about procedural necessity typically starts with a small probe sample, followed by a statistically valid random sample if the probe raises questions worth pursuing further.
- A new privileging decision or contract performance review often calls for a defined sample across a set time period, sized to give the committee a fair read on practice patterns that may be tied closely to physician enterprise alignment and workforce planning decisions.
In other words, form should follow function. The review should be sized and shaped to match the actual concern, not a default number pulled from habit or last year’s process.
What Questions Are You Trying to Answer?
Leadership needs to clearly state the purpose of the review so that everyone involved, from the medical staff office to the reviewing physicians, is working toward the same goal. Examples of common questions include:
- Did the care provided meet the applicable standard of care for this patient's clinical circumstances?
- Was the surgical or procedural approach appropriate, technically sound, and aligned with accepted clinical practice?
- Does the documentation accurately and sufficiently reflect the clinical reasoning, medical decision-making, and rationale behind key decisions?
- Were communication, coordination, and collaboration between involved specialties timely, effective, and appropriate for the patient's needs?
- Do the cases reviewed represent a pattern that suggests an opportunity for additional education, mentoring, or competency assessment?
- Were there opportunities where different clinical decisions or earlier interventions may have improved the patient's outcome?
- Do the reviewed cases demonstrate the knowledge, clinical judgment, technical skill, and outcomes necessary to support a new privilege or continued clinical competency?
Each of these is a different question with a different case set behind it. When a medical staff committee reaches consensus on the specific questions it needs answered, the number and type of cases required to answer them become far easier to determine and to defend later if the review is ever challenged.
What Will You Do With the Findings?
This is the question organizations skip most often, and it’s the one that determines whether a review is defensible later. When leadership considers the possible outcomes in advance, the process has a far better chance of being defensible. Could corrective action be on the table? Could findings point toward a need for focused professional practice evaluation? Could this feed into a payer contract discussion or, in rarer cases, a federal self-disclosure situation? Thinking through the range of outcomes before the review begins, not after opportunities are identified, helps you identify the right number and types of cases to support a defensible decision, whatever that decision turns out to be.
Let the Strategy Lead
External peer review can’t be a mechanical exercise where every case triggers the same fixed sample size. It takes a strategic approach that starts with purpose and works backward to case selection, not the other way around. The three questions above, what prompted the review, what you’re trying to answer, and what will you do with the findings, are the foundation of that strategy.
Acuvance Coker brings deep, focused healthcare experience and a proven methodology to this work. Our physician reviewers span virtually every specialty and subspecialty, and our approach is built specifically to produce reviews that hold up under scrutiny, whether from a medical staff committee, a payer, or outside counsel. If your organization is considering an external peer review and isn’t sure where to start, contact our team to discuss the right approach for your situation.
Choosing the Right Path for Your Organization
Not sure how case selection should work for your next review? Explore our Clinical Review Support services to see how our team supports organizations through the full peer review process, or browse our approach to clinical performance and quality improvement. Ready to talk specifics? Connect with our team.
