Fidelity Monitoring: Is Your Program Quietly Reinventing Itself?

By Sarah Launius, PhD

In a previous newsletter, I shared the difference between process evaluation and outcome evaluation—specifically, when to focus on the how versus the what. Understanding that distinction is foundational. Now, let’s take the next step.

Over the coming issues, we’ll dig into practical, common evaluation approaches you can actually implement to ensure your programs are making the intended impact. Up first is a key strategy within process evaluation: fidelity monitoring.

Imagine you designed a brilliant program. You mapped the activities, clarified the target population, and defined the core components that make your model work. You trained your staff and launched with energy and optimism.

Fast forward 9 months.

The program is running. Participants are showing up. Staff are working hard. But the outcomes? They aren’t quite where you expected them to be. Naturally, you start asking reasonable questions:

• Are participants receiving enough of the program? 

• Are we serving the right people? 

• Is the curriculum strong enough?

While these are important, the most critical question often goes overlooked: Are we actually doing what we said we’d do?

If process evaluation is about the "how" of a program, fidelity monitoring narrows the lens even further. It asks whether the program is being implemented as originally designed to increase the likelihood of replicating success across all participants.

It’s not a critique of staff commitment or effort. Rather, it’s an assessment of whether the essential components—the specific drivers of your results—are happening consistently and completely.

In the nonprofit world, "drift" happens naturally. A facilitator skips a reflection exercise because participants seem restless. Someone else adds a new activity they found online that feels like a better fit. A new hire shadows a veteran staff member and unknowingly learns a slightly modified version of the model.

None of this is malicious. In fact, it’s usually well-intentioned. Nonprofit teams are responsive; they adapt and solve problems in real time. But adaptation without guardrails can slowly turn into drift. If we don’t track these changes, we miss out on "universal adaptations" that might actually improve program impact—or we unknowingly dilute the elements that made the program work in the first place.

Fidelity monitoring is a vital part of continuous quality improvement. In practice, it might look like:

• A simple implementation checklist outlining non-negotiable components for each session.

• Occasional observations focused on coaching rather than compliance.

• Clear boundaries between what staff can adapt and what must remain consistent.

• Standardized onboarding to ensure new team members receive the same training as the original crew.

To be clear: this is not about micromanaging professionals or stifling innovation. It’s about protecting the integrity of your model. When outcomes fall short—or exceed expectations—you need to know why. Without monitoring fidelity, you’re left guessing. Did the model fail? Was implementation uneven? Did we unintentionally change the very elements supposed to produce results?

So when should you take this approach?

Fidelity monitoring is especially valuable in the first year of implementation, when launching at new sites, when onboarding new staff, or anytime outcomes vary more than expected. It doesn’t have to be constant to be effective. Quarterly check-ins, periodic observations, or structured reviews a few times per year are often enough to spot patterns early. The key is that it’s conducted by someone trained in the approach, typically a program manager, supervisor, or designated quality lead, and framed as supportive learning rather than compliance policing.

For nonprofit leaders, there’s a simple but powerful question embedded in all of this: If I walked into a session tomorrow, would I see what we described in our proposal?

Programs evolve, but evolution should be intentional, documented, and strategic. Not the byproduct of time pressure, turnover, or quiet workarounds.

Before you ask whether your program is working, pause and ask whether it’s being implemented as designed. Some basic checks to ensure fidelity alignment might be the most grounding and most empowering evaluation step you take this year.

And as always, if you’d like help designing practical fidelity tools that strengthen your team while protecting your impact, Bynes Consulting Group is here to support you.