Skip to content
IndieMakerList

Simon Willison's predictions

Public predictions Simon Willison (@simonw) made from 2023-11 to 2026-11, each checked against what happened.

62.5%2 resolved · low confidence

low confidence

1 mostly true · 1 partly true · 1 pending

Needs 5 resolved predictions to be ranked. This score is low confidence.

Next deadline: 2027-08-17. Pending calls are not part of the score.

By topic

Accuracy on the calls that have resolved, with the sample size.

  • AI industry75%

    1 resolved · low confidence

  • AI pricing50%

    1 resolved · low confidence

Longest-horizon call

Stated deadline 2025-12-21.

  • Partly true2024-12-21· AI pricing· due 2025-12-21
    @MolloyLaurence The price of running a GPT3 class model appears to have dropped by a factor of 100x in 24 months, I expect we will see at least a 10x drop on costs to run o3 within a year

    Expected at least a 10x drop in the cost of running o3 within a year. OpenAI cut o3 by 80% (5x) on 2025-06-10, from $10/$40 to $2/$8 per M tokens, with no model change. Real and large, but half the predicted factor for o3 itself.

    Original (x.com)simonwillison.net

Scored predictions

  • Partly true2024-12-21· AI pricing· due 2025-12-21
    @MolloyLaurence The price of running a GPT3 class model appears to have dropped by a factor of 100x in 24 months, I expect we will see at least a 10x drop on costs to run o3 within a year

    Expected at least a 10x drop in the cost of running o3 within a year. OpenAI cut o3 by 80% (5x) on 2025-06-10, from $10/$40 to $2/$8 per M tokens, with no model change. Real and large, but half the predicted factor for o3 itself.

    Original (x.com)simonwillison.net

  • Mostly true2024-06-22· AI industry· due 2024-12-31
    @nedcoder I respect that. I'm still looking forward to the first genuinely useful LLM trained on entirely licensed or out-of-copyright data - I think it's going to happen this year

    Predicted a genuinely useful LLM trained only on licensed/out-of-copyright data in 2024. Pleias 1.0 (2024-12-05) was billed as the first models trained exclusively on open data. They are small (350M-3B) and some licensing questions remain, so MOSTLY_TRUE.

    Original (x.com)huggingface.co

Pending

Not resolved yet, so not counted. Dated calls are listed first.

  • Pending2025-08-17· Developer tools· due 2027-08-17
    @jeffrschneider @asmeurer @mitsuhiko I expect that within a year or two the vast majority of code written by professional programmers will have had LLMs involved at some point - code completion, code review, looking up common patterns etc At which point calling that "vibe coding" won't convey anything useful

    Within a year or two, most professional code touched by LLMs.

    Original (x.com)

Compare with other makers

All predictors →
  • Tony Dinh avatar
    Tony Dinhlow confidence

    6 scored · 3 pending

    91.7%6 resolved · low confidence
  • John Rush avatar
    John RushOptimist · medium confidence

    8 scored · 9 pending · 6 not checkable

    43.8%8 resolved · medium confidence
  • Pieter Levels avatar
    Pieter Levelslow confidence

    5 scored · 7 pending

    20%5 resolved · low confidence
  • Sam Parr avatar
    Sam Parrlow confidence

    2 scored · 0 pending · 1 not checkable

    100%2 resolved · low confidence
  • Ian Nuttall avatar
    Ian Nuttalllow confidence

    1 scored · 4 pending · 1 not checkable

    100%1 resolved · low confidence
  • Steph Smith avatar
    Steph Smithlow confidence

    1 scored · 0 pending

    100%1 resolved · low confidence

Simon Willison's maker profile →Last checked 2026-11-05

Frequently asked questions

How accurate are Simon Willison's predictions?

Simon Willison's tracked predictions score 62.5% across 2 resolved calls (low confidence). 1 is still pending.

How is the score calculated?

Came true = 1, mostly true = 0.75, partly true = 0.5, mostly wrong = 0.25, wrong = 0, averaged over resolved predictions. Pending calls and posts that are too vague to check are not scored. Personal goals are included unless the filter on this page is checked. Confidence is low below 8 resolved, medium from 8 to 15, and high above 15.