Are AI predictions accurate? (the honest answer)
They're good, not magic. Here's what to expect — and why win rate alone is the wrong way to judge a model.
Here's the honest version, because an integrity brand shouldn't oversell.
The AI models are genuinely good at confident, one-sided matches and roughly comparable to a sharp human on the rest. Over a large sample, the best models land in a realistic win-rate band — not the 70–80% you'll see claimed elsewhere, which is almost always overfit or cherry-picked.
Win rate is the wrong headline
A model can ace every blowout and still hover near a coin flip overall, because draws and close games drag everyone back to the pack. The signals that actually survive scrutiny are:
- Calibration — when a model says "70%", does it win about 70% of the time?
- Closing-line value — does it consistently pick at prices better than the market's closing line? That's the sharpest skill signal in prediction markets.
Did this answer your question?