Simon Willison's predictions
Public predictions Simon Willison (@simonw) made from 2023-11 to 2026-11, each checked against what happened.
low confidence
1 mostly true · 1 partly true · 1 pending
Needs 5 resolved predictions to be ranked. This score is low confidence.
Next deadline: 2027-08-17. Pending calls are not part of the score.
By topic
Accuracy on the calls that have resolved, with the sample size.
- AI industry75%
1 resolved · low confidence
- AI pricing50%
1 resolved · low confidence
Longest-horizon call
Stated deadline 2025-12-21.
- Partly true2024-12-21· AI pricing· due 2025-12-21
@MolloyLaurence The price of running a GPT3 class model appears to have dropped by a factor of 100x in 24 months, I expect we will see at least a 10x drop on costs to run o3 within a year
Expected at least a 10x drop in the cost of running o3 within a year. OpenAI cut o3 by 80% (5x) on 2025-06-10, from $10/$40 to $2/$8 per M tokens, with no model change. Real and large, but half the predicted factor for o3 itself.
Scored predictions
- Partly true2024-12-21· AI pricing· due 2025-12-21
@MolloyLaurence The price of running a GPT3 class model appears to have dropped by a factor of 100x in 24 months, I expect we will see at least a 10x drop on costs to run o3 within a year
Expected at least a 10x drop in the cost of running o3 within a year. OpenAI cut o3 by 80% (5x) on 2025-06-10, from $10/$40 to $2/$8 per M tokens, with no model change. Real and large, but half the predicted factor for o3 itself.
- Mostly true2024-06-22· AI industry· due 2024-12-31
@nedcoder I respect that. I'm still looking forward to the first genuinely useful LLM trained on entirely licensed or out-of-copyright data - I think it's going to happen this year
Predicted a genuinely useful LLM trained only on licensed/out-of-copyright data in 2024. Pleias 1.0 (2024-12-05) was billed as the first models trained exclusively on open data. They are small (350M-3B) and some licensing questions remain, so MOSTLY_TRUE.
Pending
Not resolved yet, so not counted. Dated calls are listed first.
- Pending2025-08-17· Developer tools· due 2027-08-17
@jeffrschneider @asmeurer @mitsuhiko I expect that within a year or two the vast majority of code written by professional programmers will have had LLMs involved at some point - code completion, code review, looking up common patterns etc At which point calling that "vibe coding" won't convey anything useful
Within a year or two, most professional code touched by LLMs.
Compare with other makers
91.7%6 resolved · low confidence
43.8%8 resolved · medium confidence
20%5 resolved · low confidence
100%2 resolved · low confidence
100%1 resolved · low confidence
100%1 resolved · low confidence
Simon Willison's maker profile →Last checked 2026-11-05
Frequently asked questions
How accurate are Simon Willison's predictions?
Simon Willison's tracked predictions score 62.5% across 2 resolved calls (low confidence). 1 is still pending.
How is the score calculated?
Came true = 1, mostly true = 0.75, partly true = 0.5, mostly wrong = 0.25, wrong = 0, averaged over resolved predictions. Pending calls and posts that are too vague to check are not scored. Personal goals are included unless the filter on this page is checked. Confidence is low below 8 resolved, medium from 8 to 15, and high above 15.