The mismatch is the signal

Sooner or later, every measurement programme meets a moment when the numbers say one thing and the customers say another. Operational metrics look healthy, but feedback is lukewarm. Satisfaction is high, but retention is slipping. The temptation is to treat one source as wrong.

The more useful response is to treat the disagreement as the finding. Where two credible sources disagree, something worth understanding is usually hiding in the gap.

Ask what each source is really measuring

Operational metrics measure what the system recorded: time to answer, completion rate, contact volume. They describe what happened. Feedback describes how the customer experienced what happened. The two can diverge because a process can be efficient and still feel impersonal, or fast and still leave a question unanswered.

Before reconciling the two, be precise about what each number represents, over what period, and for which customers. A disagreement between an average and a sentiment is often a disagreement between two different groups.

Look for the segment the average hid

Averages are where contradictions live. An overall satisfaction score can be stable while a specific segment — new customers, a particular channel, a region — is quietly dissatisfied. The headline looks fine; the experience for some customers does not.

Segment the data by the dimensions that matter to the business: tenure, channel, product, journey stage. The disagreement often resolves into a clearer picture of who is being served well and who is not.

Let the customer explain the gap

When the data and the customer disagree, the customer is usually pointing at something the data was not designed to see. Follow up with the customers whose experience sits behind the mismatch, and ask them to describe it in their own words.

The goal is not to make the numbers agree. It is to understand the experience accurately enough to improve it — and sometimes the most honest conclusion is that the experience is more complicated than any single metric can capture.

Ready to put insight to work?

Let’s discuss what a more actionable measurement approach could look like for your organisation.

Start a conversation