VVendorBenchmark

Methodology guide · 03

How your number is calculated.

You enter a deal. Five things happen before a number comes back, and one of them is a refusal to answer. This page walks through all of them, including the arithmetic.

Step one: which metric

Vendors do not all price on a comparable unit, so we rank on whichever measure is actually meaningful for that vendor.

MetricUsed whenYou are ranked on
Net fee per unitThe vendor sells on a unit you can count and compare: per user, per worker, per fulfiller, per core, per FUE.Your net spend divided by your units. Lower is better.
Discount off listThere is no comparable unit, because the deal is a committed spend or a bundle. Cloud commitments, enterprise agreements, capacity deals.How far below the list value you landed. Higher is better.

Amounts in other currencies are converted before anything is compared, so a euro deal is never ranked against dollar deals at face value.

Step two: your cohort

This is the step that decides whether a benchmark is honest. You are not compared against the whole market for that vendor. You are compared against the slice of it that looks like you.

START The vendor's full reference set FILTER 1 Your deal size band FILTER 2 Your region YOUR COHORT The only deals your number is measured against THE FLOOR Under 10 comparable deals, you get no percentile at all. We say so instead of inventing one.
Cohort sizes vary enormously by vendor and by where you sit. A common deal size in a dense market gives a deep cohort; a very large deal in a thin market gives a shallow one, and we tell you which you have.

The refusal. If fewer than ten comparable deals sit in your cohort, we do not produce a percentile. Not a wide one, not a hedged one, none. A benchmark built on four deals is a rumour with a decimal point, and shipping it would be the single easiest way to lose your trust in every other number we give you.

Step three: where you land

Your value is placed inside the cohort's distribution. The output is a percentile: the share of comparable buyers you are beating.

Discounts achieved by comparable buyers Illustrative shape. Every vendor and every band has its own. 10%15%20% 25%30%35% 40%45%50% Discount off list achieved YOU, AT 24% 28th percentile TARGET, 38% 75th percentile 14 points of headroom
Direction is metric aware. On a discount metric, further right is better. On a fee per unit metric the chart flips, and lower is better.

The percentile comes with a precision range derived from how many comparable deals sit behind it. A deep cohort gives a tight range. A shallow one gives a wide range, and you see the width rather than a false point estimate.

Step four: adjusting for structure

Two buyers can pay the same price and have struck very different deals. A three year commitment with a capped renewal uplift and a live competitive alternative is not the same purchase as a one year deal signed sole source in March.

So each vendor's benchmark carries the two structural levers that genuinely move price for that vendor. You set them to match your deal, and your standing is adjusted before the verdict is given.

RAW 28th on price alone THE TWO LEVERS Term length and renewal protection Competitive pressure at signature Combined effect capped at roughly ±16% ADJUSTED 33rd what the verdict uses No single lever option moves your position by more than about 8%, and the two together stay inside roughly ±16%. Structure explains part of a price gap. It is never allowed to explain all of it, because then the benchmark would just agree with you.
The levers are chosen per vendor from what actually moves that vendor, not applied as a generic template.

Step five: the ask

A percentile is a diagnosis. The number you take into the room is the ask.

  1. Find the top quartile of your own cohortThe price a buyer at the 75th percentile of comparable deals actually pays. Not the best deal ever recorded, and not the median. The top quartile is defensible: it is demonstrably achievable by buyers like you, which is exactly the argument you need.
  2. Convert it back into your termsExpressed in the unit you buy on, so it drops straight into a negotiation: a fee per user, or a discount percentage to hold out for.
  3. Price the gapThe annual difference between what you are paying now and that target. This is the number that gets the meeting.

What the ask is not. It is not a price the vendor has agreed to, and it is not a promise. It is the position the evidence supports you arguing from. What you actually land depends on your leverage, your timing and how the conversation goes, which is the part no dataset can do for you.

How we label our own confidence

Every band the platform shows carries one of three labels, on the face of the output. You never have to guess which kind of number you are looking at.

Measured

A real cohort of comparable deals sits behind it. We print how many, and the date the data is current to.

Curated

No per deal cohort, but the band was calibrated by an analyst on a known date. We say exactly that, and we never attach a made up count to it.

Directional

Neither a cohort nor a calibration date. We call it a directional estimate and you should treat it as a starting hypothesis.

The rule behind the rule. Attaching a sample size to a band that does not have one is treated internally as a defect, not a presentation choice. If we cannot show you the working, we tell you that instead of dressing an estimate up as a measurement.

Where the method is thin

Three honest limits, so you can discount our numbers appropriately rather than discovering the limits yourself.

LimitWhat it means for you
Very large dealsAbove roughly $5M of annual value, deal counts thin out for every vendor and for many vendors the curve is extrapolated from tier structure rather than dense observation. Treat those benchmarks as a strong prior, not a measurement.
Vendors that publish nothingWhere a vendor quotes everything privately and publishes no reference point, the curve rests entirely on what our sources and our own negotiation work have seen. That is real evidence, but it is narrower, and the confidence label will say so.
Very recent pricing changesWhen a vendor changes its commercial model, there is a window before the new behaviour is well observed. We re-cut the curve as soon as we see the change in live negotiations, and mark the date it was calibrated so you can judge for yourself.
VendorBenchmark LLC · Private methodology guide · Not for redistribution July 2026