neatlogs
Traces every run.
The planner, executor and verifier show up as spans, so a bad run has a cause you can read.
neatlogs.com
Docs that work (literally).
Paste a docs URL. Your coding agent runs the quickstart in a clean container, finds the step that breaks, fixes it, and proves the fix.
Try
A partial URL works. So does a tool name. Nothing leaves your browser.
Verified
Watch the replayA saved run. Nothing to install.
Run it fresh with your agent
- Your agent installs FirstRun and checks Docker
- Runs your quickstart in a clean container
- Fixes and proves it in a second clean run
- Opens the PR when you say yes
Read. Run. Prove.
Read
FirstRun reads the page and plans one step per command.
Run
Every step runs in a clean container, like a new developer. The first failure stops the run.
Prove
A fix is not done until a second clean container passes the whole quickstart.
Watch a Real Run.
Every run ends with a share link. Replay one.
Known-broken fixtureA pip pin that cannot install
dbt + DuckDBA real quickstart
DagsterA real quickstart
$ pip install git+https://github.com/HighnessAtharva/firstrun
$ firstrun https://docs.getdbt.com/guides/duckdb
$ firstrun pr <run> # prints the gh commands for the docs PR
Prefer the terminal? You need Docker and a Claude token from claude setup-token.
Three Tools. One Job Each.
Entire
Records every session.
Each commit carries the Claude Code session that wrote it, so any line traces to a prompt.
entire.io
cfo.ai
Turns cost into a plan.
The measured cost per run from neatlogs goes to Ari, the cfo.ai agent, which models the pricing.
cfo.ai
The Numbers Come From Real Runs.
Same four quickstarts, before and after the fix neatlogs found. Real open-source docs after that.
2 → 3of 4 quickstarts finish, v1 to v2
0 → 3failed steps recovered
4 of 5real open-source quickstarts verified in a fresh container
3upstream docs PRs opened: dbt #10149, dbt #10150, Entire #2724
$0.02model cost per run, measured by neatlogs (list price, not billed)
The Build, in Public.
Every step is a post on @cultist_dev.
- Sat Oct 10, 10:45
my neatlogs hackathon project has already caught doc issues for a chroma (24K+ github stars). chromadb's deprecated-config error sends you to its own migration guide. that page returns 404.
Read the post on X - Sat Oct 10, 12:30
#neatHack kickoff, 12:30 IST. FirstRun code before kickoff: 0 lines. neatlogs doctor probe: 7/7 PASS. Solo build. Submission opens Monday, 7 PM IST.
Read the post on X - Sat Oct 10, 13:14
#neatHack, day one. all three required tools are up. Entire: trail #1 created. neatlogs: first agent trace, 3 steps, 12s. cfo.ai: Ari read my public profile.
Read the post on X - Sat Oct 10, 13:26
your quickstart is the only part of your product tested by people who leave instead of filing a bug. so for #neatHack i'm building FirstRun. break. fix. prove.
Watch the video on X - Sat Oct 10, 15:15
a quickstart breaks the way an agent breaks. quietly. so the plan for this weekend: every FirstRun run becomes a trace in @neatlogs.
Read the post on X - Sun Oct 11 to Mon Oct 12More posts land here as the weekend goes.
Atharva Shah
Atharva is a DevRel engineer. He owns developer docs at AccuKnox and works with Altimate AI.
A quickstart that breaks without a sound is a docs bug nobody reports. FirstRun is his answer. He built it alone during the hackathon, in public.