Lennox Saint
Open menu
BuilderBench

which AI should you hand your real work to?

i give them mine. same jobs, same clock. i score the work, lock the scores, then publish the result, the limits and the corrections.

the latest answer: Gemini 4 Argon did my real work best this round. see why

free. unsubscribe any time, one click. privacy.

BuilderBench · how it works
latest result · 14 October 2026v3 · pack 3.0.0 · owner-finalized partial personal reviewGemini 4 Argon did my real work best this round.Gemini 4 Argon with BuilderBench API harness scored 45.38 out of 100. Muse Wonder Full with Muse Code scored 39.91. same jobs.Gemini 4 Argon with BuilderBench API harness45.38/100quality 39.12 · autonomy 60 · proactivity 60API estimate US$8.92 · partial usage · not a billMuse Wonder Full with Muse Code39.91/100quality 37.73 · autonomy 45 · proactivity 45API estimate unavailable · usage unavailable · not a billone owner review of one run per setup. a lead in one assessment is not a ranking. the review conditions, API rates and limits are on the result page.open the full result

every cleared score · out of 100

one run per setup. grouped by pack.

v1–v3: quality 70% · autonomy 20% · proactivity 10%. different packs are different tests, so there is no overall winner.

why you’d care:a score is how good the finished work was (70%), how little hand-holding it needed (20%), and whether it caught things i didn’t ask for (10%). higher means less fixing after the AI hands the job back.

v3

pack 3.0.0

latest cleared result: 14 October 2026

the current cohort

ten real jobs built around Threadify.

v3 uses useful Threadify source material. the landing-page task improves the current public page as a benchmark preview. it does not replace production. the new app task makes each setup choose and build a working Threadify-adjacent lead magnet.

the build window is four hours. native live sessions are timed and recorded separately from the build window. 6 setups on pack 3.0.0: Sonnet 5.5 with Claude (29 September), GPT-6.1 Sol with Codex (30 September), GPT-6 Luna with Codex (8 October), Haiku 5.5 with Claude (8 October), Gemini 4 Argon with BuilderBench API harness (14 October), Muse Wonder Full with Muse Code (14 October). Each score is one owner review of one run, with its own limits. Not a universal model ranking.

see all ten tasks

how it works

four rules. no exceptions.

  1. real jobs, not puzzles.

    a frozen pack of work i actually do: writing, landing pages, browser jobs, workflow fixes.

    BuilderBench v1
  2. every job is weighted.

    each job counts for a set share. the scores roll up into one number out of 100.

    from LAB 0009
  3. reviewed. then locked.

    named review is the default. a blind comparison hides two or more setups until the scores lock.

    from LAB 0009
  4. costs and mistakes go public too.

    every score, each model's API rates, the run estimate, the limits and any correction. dated.

    from LAB 0009
from LAB 0009

the point: your work is the benchmark.

steal the method. score the AI on your own jobs.

read the full method
what this doesn’t prove
  • each score is one owner's review of one run per setup. it is not a universal model ranking.
  • a score belongs to the full setup: model, harness, tools and settings.
  • different task packs are different tests. scores only compare inside one pack.
  • costs are API-equivalent estimates with stated coverage, not bills. actual spend stays unknown unless it was receipted.
  • API rates are a dated snapshot from the provider's own page. they are not the cost of a run.
  • not every run was blind. each result says how it was reviewed.
  • every result page lists its own limits, review scope and any correction.
how the scoring works

each setup gets the same frozen pack and the same four-hour build window. native sessions are timed separately. named review is the default: the model name shows. a blind comparison is something i ask for when two or more models run together, and it hides the names until the scores lock. v1–v3 weigh quality 70%, autonomy 20% and proactivity 10%. a later v4 pack will use 90/5/5. old scores are never recalculated.

read the full method

version history

a changed job or weight starts a new cohort.

  1. v3 · pack 3.0.0

    14 October 2026

    latest cleared result: 14 October 2026

    6 setups on pack 3.0.0: Sonnet 5.5 with Claude (29 September), GPT-6.1 Sol with Codex (30 September), GPT-6 Luna with Codex (8 October), Haiku 5.5 with Claude (8 October), Gemini 4 Argon with BuilderBench API harness (14 October), Muse Wonder Full with Muse Code (14 October). Each score is one owner review of one run, with its own limits. Not a universal model ranking.

    open the cleared resultsee all 4 cleared pack 3.0.0 results
  2. v2 · pack 2.0.0

    26 September 2026

    latest cleared result: 26 September 2026

    One owner-scored personal assessment of one GPT-6 Astra run with Codex on the v2 pack. This is not a universal model ranking or a statistical claim.

    open the cleared result
  3. v1 · pack 1.0.0

    24 September 2026

    one cleared pilot

    The first eight-task pilot. Its locked scores, limits and correction receipt stay unchanged.

    open the cleared result

changelog

every change, dated. corrections get their own line.

  1. method· v4

    v4 plan: the writing tests use the real templates

    From pack v4, the X article, Threads post and Threads thread follow the same templates Lennox uses for real: his X article skill, his listicle plug template and Threadify's long-form thread template. The YouTube script follows the shape of his Threadify proof loops videos. A benchmark should test the real job, not a task made up in a vacuum. The templates stay private. v3 scores do not change, and v4 scores can't be compared with v3. No v4 run has started.

    open it
  2. new result· v3

    v3 result: Gemini 4 Argon 45.38, Muse Wonder Full 39.91

    Gemini 4 Argon with the BuilderBench API harness scored 45.38 and Muse Wonder Full with Muse Code scored 39.91 on pack 3.0.0. Argon leads this assessment by 5.47 points. Owner-finalized partial personal review of one run per setup. Not equal conditions: Extra High was requested but Argon ran on High, the two used different tools, a storage problem interrupted the build window, and the operator logs leaked identity clues. 3 of 4 native recordings have gaps. Argon's cost is a partial estimate; Muse Wonder Full's is unknown. Not a ranking.

    open it
  3. correction· v3

    correction after release: result graphic labels

    The Luna and Haiku result graphic printed "candidate A" and "candidate B" under the model names, and a stray dash after "extra high". Both were taken out. Every score, price and caveat is unchanged.

    open it
  4. new result· v3

    v3 result: GPT-6 Luna 44.58, Haiku 5.5 39.18

    GPT-6 Luna with Codex scored 44.58 and Haiku 5.5 with Claude scored 39.18 on pack 3.0.0. Luna leads this assessment by 5.40 points. Owner-finalized partial personal assessment of one run per setup; the original execution, native recordings and continuous review are incomplete, and the limits are on the page. Not a ranking.

    open it
  5. method· v3

    how runs work now: named by default, separate native ratings, API prices on every result

    new runs keep ten task families, 70% quality, 20% autonomy and 10% proactivity, a four-hour build window and separately timed native sessions. named review is the default. a blind comparison is requested when two or more models run together. task 9 is conductor-scored with evidence. other owner ratings stay blank until supplied. future lead magnets get one owner rating for look and feel. the browser and computer prompts are now open demonstrations, and the computer one excludes browsers. each rating has its own help text. every result shows each model's official API rates, apart from the run estimate and the actual bill. older runs keep their frozen task versions and rubrics.

    open it
  6. correction· v3

    Sonnet 5.5 v3 graphic date

    The Sonnet 5.5 v3 result graphic shows 30 September 2026. That is the day the partial review was finalized. The run itself was on 29 September 2026, as the result page says. Scores, costs and limits are unchanged.

    open it
  7. new result· v3

    GPT-6.1 Sol v3 result is public

    GPT-6.1 Sol with Codex scored 41.75 on pack 3.0.0. Owner-finalized partial personal assessment; independent checks and native recordings did not finish, and the limits are on the page.

    open it
  8. new result· v2

    GPT-6 Astra v2 result is public

    GPT-6 Astra with Codex scored 53.75 on pack 2.0.0. Personal assessment; the owner accepted incomplete browser and computer recordings on the record, and the limits are on the page.

    open it
  9. new result· v3

    Sonnet 5.5 v3 result is public

    Sonnet 5.5 with Claude scored 48.98 on pack 3.0.0. Owner-finalized partial personal assessment; execution was interrupted and the limits are on the page.

    open it
  10. method· v4

    future versions: 90% quality, 5% autonomy, 5% proactivity

    quality will carry 90% of the overall score in future benchmark versions, with autonomy and proactivity at 5% each. this starts with the next major pack, v4. the current v3 run and all earlier results keep their original 70/20/10 weights. no v4 scored run has started. scores from different packs remain separate historical references.

    open it
  11. method· v3

    clearer review, saved answers and visible cost coverage

    single-model reviews show the model name. blind review is reserved for comparisons of two or more models. the conductor reviews task 9 and records its evidence and scores. founder answers and generated documents are archived for later review. future review screens render Markdown tables and reject predominantly black recordings. the private cost view shows API-equivalent estimates with the number of saved records priced. estimates are not bills, and missing usage stays missing. the current v3 review is still provisional; there is no cleared public v3 result.

    open it
  12. method· v3

    v3 method: ten task families on real Threadify work

    Threadify work, ten task families, a working lead-magnet app, and repeatable owner-supplied computer tasks. Calibration is pending, so there is no v3 score yet.

    open it
  13. new cohort· v2

    v2: real episode footage and thumbnail packaging

    The suite added real episode footage and thumbnail packaging. Its results are not in the public archive.

  14. new result· v1

    v1 pilot result: Opus 5.5 68.26, GPT-6 Sol 45.55

    Opus 5.5 with Claude scored 68.26 and GPT-6 Sol with Codex scored 45.55. One owner-scored run per setup, so it is not a universal model ranking.

    open it
  15. correction· v1

    correction before release: stale missing-file flags

    After the scores were locked, live-chat deliverables were still flagged as missing. The frozen files and their hashes were checked again, and they were there. My ratings of the work did not change. Only the missing-file flags did.

    open it
  16. new cohort· v1

    v1: the first eight-task pilot

    The first eight-task pilot: two AI setups, the same frozen jobs, the same four-hour clock, scored blind.

    open it

cleared results

grouped by task pack. different packs don’t compare.

p.s.

get the next BuilderBench result first.

  • the exact prompt i typed
  • what came back
  • where it fell over

free. unsubscribe any time, one click. privacy.

  • 32,718 on Threads
  • 3,675 readers
  • 1.84K on YouTube

live count, 24 oct 2026 / 25 oct 2026.