CodeHerderSearch⌘KRequest access →

Examples · Refactor

Two reports answering the same question, one of them telling you not to trust it

Deleted the legacy first-pass-rate report everywhere it lived in the product, and pointed the docs at the stage-signals report that already replaced it.

$70.52
Cost, start to finish
4h 13m
Lead time, filed to merged
45
Files changed in the merge

Measured from this task's real merge.

Cost
$70.52
Turns
625
Lead time
4h 13m
Merged
Sep 15, 2026
Diff
45 files · +195 -1077

CodeHerder had two reports for 'first-pass rate by model and stage': an old one, and the workflow-aware report that replaced it. The product's own docs and CLI already told readers to ignore the old one and use the new one instead.

What was asked for

Identify the single most impactful source of unnecessary complexity in this repo, and ship one cohesive change that makes it meaningfully simpler.

Filed by a developer, routed by capability (go, react).

What the herd did

  1. plan
  2. code
  3. review
  4. merge
  5. verify
  6. done
plan
Compared the two reports and confirmed every product surface already steered readers away from the old one, then scoped the removal to the whole product.
code
Deleted the old report's API route and its CLI command, then removed its SPA section too. The newer stage-signals report stayed untouched.
review
Tightened the archguard test that pins the legacy data path's reader count, so every survivor is now purely internal.
merge
Forty-five files. The API handler and wire types changed. The CLI command and the SPA page changed too, and so did the docs describing the old report.
verify
Confirmed the old route and command are gone, and the old section is gone too. The replacement report still answers the same question.
done
$70.52 across 625 turns, the largest deletion in this set at 1,077 lines removed.

What it changed

The merge touched 45 files (+195 −1077). Among them:

  • internal/evalsuite/handler.go
  • internal/evalsuite/repo.go
  • cmd/ch/quality.go
  • app/src/pages/ReviewDebt.tsx
  • docs/api.md

What it cost

$70.52 in model spend, 625 agent turns, and 4h 13m from filed to merged. See what a month of work like this would cost your own team on our cost calculator.

A report that tells you not to trust it is surface area, not a safety net.

CodeHerder

Got something like this to ship?

Tell us what you're building. We'll set your workspace up and you can file it today.

Try "pricing", "connect a device", or "who reviews the code"

↑↓ move · ↵ open · esc close