chalk.bar

When is a margin real?

Across eleven thousand recent contests, most Best Lifter margins are narrower than the statistical noise of the formula that decides them. Here is the flip-risk curve — and the margin at which you can stop arguing about statistics.

This series has established two things. A GoodLift score is one fitted curve's opinion of a performance, and there are many defensible curves. And when the stakes are highest — the Sheffield, where the formula is the whole competition — those curves crown different athletes. The natural next question leaves any single meet behind. Forget who should have won; how large does a GoodLift margin have to be before the modelling stops mattering?

Flip risk

Take two lifters in the same contest whom GoodLift separates by some margin. Call the pair flipped if at least one of our eighteen defensible analyses puts them in the other order. We measured this for every pair in the top ten of every IPF-family raw contest since 2018 with a meaningful field — 10,924 contests, around 423,000 pairs — and read it two ways. The stricter reading counts flips only among the elite-calibrated analyses, the ones that accept GoodLift's own answer to who defines expected performance and vary only the shape of the curve. The broader reading counts a flip under any of the eighteen, normative disagreements included.

across all 18 analyseswithin GL's elite calibration only0%20%40%60%024681012GoodLift margin between two lifters, points5% flip risk
The share of pairs whose GoodLift order is overturned by at least one defensible analysis, by the GoodLift margin between them. Flip risk here is a share of analyses, not a probability — and eighteen analyses are a floor on model uncertainty, not a ceiling.

There is no cliff — no magic margin where uncertainty ends. But the decay is steady, and it gives the sport its numbers. A margin under half a point is close to a coin flip: about half of such pairs reverse somewhere in the multiverse, and two in five reverse even granting GoodLift its own calibration. Flip risk falls below 5% at about 4 points on the strict reading and 6 points on the broad one, and below 1% at roughly 8 and 12 points respectively.

How often real contests live inside the noise

Those thresholds would be trivia if real contests were usually decided by twenty points. They are not.

04008001,2002,337 contests decided by 0–1 points1,525 contests decided by 1–2 points1,359 contests decided by 2–3 points1,057 contests decided by 3–4 points923 contests decided by 4–5 points685 contests decided by 5–6 points591 contests decided by 6–7 points475 contests decided by 7–8 points394 contests decided by 8–9 points333 contests decided by 9–10 points255 contests decided by 10–11 points184 contests decided by 11–12 points160 contests decided by 12–13 points121 contests decided by 13–14 points98 contests decided by 14–15 points427 contests decided by 15–16 points0246810121415+winning margin, GoodLift points — 10,924 contests since 20185% risk, GL's calibration5% risk, all analyses
Winning margins — first place over second, GoodLift points — across the same 10,924 contests, with the two 5% flip-risk thresholds marked.

The median winning margin is 3.2 points. One contest in five is decided by less than a single point, where flip risk runs near 40% even on the strict reading. Take the stricter threshold — the one that concedes GoodLift every normative choice it makes — and 58% of winning margins sit inside it. Take the broad one and it is 73%. Most of the Best Lifter awards handed out in the last eight years were decided by a margin the modelling could plausibly have swallowed. This is exactly the uncertainty band a serious comp plan has to navigate when it recommends third attempts.

What to do with a number like that

Do not throw out the formula. Any single-formula system — DOTS, Wilks, any replacement anyone might propose — has a spread of uncertainty; publishing one canonical table is a choice about governance, not evidence the spread is zero. The failure mode isn't using GoodLift. It's treating a 0.4-point margin as if it were a 40 kg one.

So, rules of thumb from this analysis: under a point, the order of two lifters is a modelling artefact — celebrate both. Inside about four points, the result stands on GoodLift's normative choices as much as on the lifting; that is the region where a federation might reasonably say the award is decided by our published formula, which is a rule, and rules settle ties. Past about eight points, stop arguing about statistics — the stronger performance won under every defensible description of the sport we could construct.

This is also, in the end, the house point. A score is a number; a decision needs the number to clear its own uncertainty, and now the uncertainty has a size. That habit — never a number without its spread — is what chalk.bar is built on, whether the number is a GoodLift point or your own projected total.

The caveats travel with the series: contests here are top-tens within sex at each meet rather than per-division awards, the corpus is not a random sample of lifters, and the code and every data choice publish with the series so each figure can be checked.

Data: OpenPowerlifting (public domain) · more writing · privacy