Files
Codeman/test/fixtures/story-corpus/errors-push-append.expected.json
T
Codeman maintainer b98deebafc feat(story-mode): a plain Simple caption on every panel
Story Mode gets a third reading level for someone who has never seen a
terminal (a parent, a manager). Every panel now carries caption.simple:
one short sentence in everyday words, with no file name, command, tool
name, flag or jargon. The sentences are templates only, so nothing from
the transcript (a path, a commit message, a branch) can reach them, and
they are written from the same facts as the story caption: a failed
check never reads as a pass, a failure you asked for says so, and a
check that fails after one passed is a failure again.

The final panel's simple caption is a plain summary: how the turn ended
and roughly how long it took, how many files changed, whether the checks
pass, whether the work is saved (only claimed "not saved" where saving
is in play: you asked for it, or the turn used git), and what the reader
must not miss (a problem left, a note, a question for them).

test/story-plain-words.ts is the guard: the corpus test runs it over
every panel of every page of the eleven sessions, and the unit tests
cover the honest endings (failed check, catch, note, question, stopped,
not done, to be continued, done for now) and the guard itself. The
corpus expectations only gain "simple" lines.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-19 05:17:31 +02:00

390 lines
13 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
[
{
"prompt": "Build a tiny Python module calc_stats.py with mean(xs) and median(xs), strictly test-first: FIRST wr",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 130001,
"toolCalls": 10,
"filesChanged": 3,
"added": 81,
"removed": 0,
"helpers": 0,
"helpersRunning": 0,
"finishedLater": 0,
"openNote": false,
"asks": false,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"simple": "You give Claude a job.",
"unaskedSave": false,
"director": "Prompt · 55 words",
"balloon": "Build a tiny Python module calc_stats.py with mean(xs) and median(xs), strictly test-first: FIRST write tests/test_calc_stats.py that imports calc_stats, THEN run python3 -m pytest -q once while calc_stats.py does not exist yet (it must error at collection), THEN write calc_stats.py and run python3 -m pytest -q again until it passes. Install nothing, stay in this folder.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "investigate",
"ok": null,
"story": "Claude looks around the project.",
"simple": "Claude looks around the project.",
"unaskedSave": false,
"director": "Bash ×2 · ls -la && git log --oneline -5 2>&1; git status; python3 --…",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 2
},
{
"kind": "run",
"ok": null,
"story": "Claude works in the terminal.",
"simple": "Claude runs some steps on the computer.",
"unaskedSave": false,
"director": "Bash ×2 · python3 -c \"import calc_stats\" 2>&1 | tail -1; ls pytest.in… · 1 second opinion along the way",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 3
},
{
"kind": "fix",
"ok": null,
"story": "Claude writes the new file test_calc_stats.py.",
"simple": "Claude writes a new file.",
"unaskedSave": false,
"director": "Write · test_calc_stats.py +55",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "check",
"ok": false,
"story": "The tests don't even load, as you asked.",
"simple": "The checks can't even start, as you asked.",
"unaskedSave": false,
"director": "python3 -m pytest -q → error · 0 passed, 1 error",
"balloon": "Now the red run, once, with calc_stats.py confirmed absent:",
"tests": {
"passed": 0,
"failed": 0,
"errors": 1
},
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "save",
"ok": true,
"story": "Claude writes .gitignore and saves the work: \"add failing tests for calc_stats mean/median\".",
"simple": "Claude writes a file, then saves the work.",
"unaskedSave": true,
"director": "git commit -q -F - · writes 1 file",
"balloon": "Red as expected: collection error, exit code 2.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "fix",
"ok": null,
"story": "Claude writes the new file calc_stats.py.",
"simple": "Claude writes a new file.",
"unaskedSave": false,
"director": "Write · calc_stats.py +24",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "check",
"ok": true,
"story": "The tests pass.",
"simple": "Claude checks the work: everything passes.",
"unaskedSave": false,
"director": "python3 -m pytest -q → ok · 12 passed",
"balloon": "Green on the first implementation pass.",
"tests": {
"passed": 12,
"failed": 0
},
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "save",
"ok": true,
"story": "Claude saves the work: \"implement calc_stats mean and median\".",
"simple": "Claude saves the work.",
"unaskedSave": false,
"director": "git commit -q -F - · then 1 second opinion",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 2
},
{
"kind": "complete",
"ok": null,
"story": "Done in 2 minutes.",
"simple": "Done in about 2 minutes. 3 files changed. The checks pass. The work is saved.",
"unaskedSave": false,
"director": "turn_duration · 2 min 10 s · 10 tool calls · 3 files changed",
"balloon": "I built it test-first: the suite failed at collection before calc_stats.py existed, then passed once the module was written. I didn't push, didn't touch origin.git/ and didn't create a README, since none existed to keep in sync.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 0
}
]
},
{
"prompt": "Add mode(xs) to calc_stats.py (ValueError on empty input, ties return the smallest value) in two sep",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 36880,
"toolCalls": 8,
"filesChanged": 2,
"added": 40,
"removed": 1,
"helpers": 0,
"helpersRunning": 0,
"finishedLater": 0,
"openNote": false,
"asks": false,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"simple": "You give Claude a job.",
"unaskedSave": false,
"director": "Prompt · 95 words",
"balloon": "Add mode(xs) to calc_stats.py (ValueError on empty input, ties return the smallest value) in two separate steps without committing in between and without consulting the advisor: first add mode tests to tests/test_calc_stats.py and run python3 -m pytest -q (it should fail because mode is missing), then implement mode in calc_stats.py and run python3 -m pytest -q again until green; only then git co…",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "loop",
"ok": true,
"story": "The first run fails on purpose, as you asked; the second passes.",
"simple": "The first check fails on purpose, as you asked, then passes.",
"unaskedSave": false,
"director": "2 checks · 3 edits · +40 −1 · last: ok",
"balloon": "Green: 18 passed and ruff is clean.",
"tests": {
"passed": 18,
"failed": 0
},
"roundsOk": [
false,
true
],
"printed": null,
"events": 5
},
{
"kind": "save",
"ok": true,
"story": "Claude saves the work: \"add calc_stats.mode with smallest-value tie-breaking\" and copies it to origin.git, a folder on this computer, but the version-tag lookup after that fails (there are no tags yet), as you said it might.",
"simple": "Claude saves the work, but a small lookup after that fails, as you said it might.",
"unaskedSave": false,
"director": "git commit -q -F - · git push -u origin HEAD",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 2
},
{
"kind": "investigate",
"ok": null,
"story": "Claude checks what it saved.",
"simple": "Claude checks what it saved.",
"unaskedSave": false,
"director": "Bash · git --git-dir=origin.git log --oneline master; git status -…",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "complete",
"ok": null,
"story": "Done in 37 seconds.",
"simple": "Done in 37 seconds. 2 files changed. The checks pass. The work is saved.",
"unaskedSave": false,
"director": "turn_duration · 37 s · 8 tool calls · 2 files changed",
"balloon": "mode(xs) is in calc_stats.py, committed once after the tests went green, and pushed. git describe --tags failed because the repo has no tags.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 0
}
]
},
{
"prompt": "In ONE Bash command, append exactly two lines to NOTES.md with cat >> NOTES.md <<'EOF' (two short li",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 26891,
"toolCalls": 5,
"filesChanged": 1,
"added": 2,
"removed": 0,
"helpers": 0,
"helpersRunning": 0,
"finishedLater": 0,
"openNote": false,
"asks": false,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"simple": "You give Claude a job.",
"unaskedSave": false,
"director": "Prompt · 66 words",
"balloon": "In ONE Bash command, append exactly two lines to NOTES.md with cat >> NOTES.md <<'EOF' (two short lines about mode) EOF and then cat calc_stats.py; next run python3 -m pytest -q; then git add NOTES.md and commit it, and push with exactly this command, run as written with nothing appended: git push && git describe --tags (it is expected to fail after pushing; just report it).",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "fix",
"ok": null,
"story": "Claude writes NOTES.md.",
"simple": "Claude writes a file.",
"unaskedSave": false,
"director": "Bash · NOTES.md +2",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "check",
"ok": true,
"story": "The tests pass.",
"simple": "Claude checks the work: everything passes.",
"unaskedSave": false,
"director": "python3 -m pytest -q → ok · 18 passed",
"balloon": null,
"tests": {
"passed": 18,
"failed": 0
},
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "save",
"ok": true,
"story": "Claude saves the work: \"add NOTES.md describing mode behavior\" and copies it to origin.git, a folder on this computer, but the version-tag lookup after that fails (there are no tags yet), as you said it might.",
"simple": "Claude saves the work, but a small lookup after that fails, as you said it might.",
"unaskedSave": false,
"director": "git commit -q -F - · git push · 1 error",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 2
},
{
"kind": "investigate",
"ok": null,
"story": "Claude checks what it saved.",
"simple": "Claude checks what it saved.",
"unaskedSave": false,
"director": "Bash · git --git-dir=origin.git log --oneline -1 master; git statu…",
"balloon": null,
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "complete",
"ok": null,
"story": "Done in 27 seconds.",
"simple": "Done in 27 seconds. One file changed. The checks pass. The work is saved.",
"unaskedSave": false,
"director": "turn_duration · 27 s · 5 tool calls · 1 file changed",
"balloon": "NOTES.md has the two lines and is committed and pushed. As you expected, git describe --tags then failed because the repo has no tags.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 0
}
]
},
{
"prompt": "Reply with just the word ok, use no tools.",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 3206,
"toolCalls": 0,
"filesChanged": 0,
"added": 0,
"removed": 0,
"helpers": 0,
"helpersRunning": 0,
"finishedLater": 0,
"openNote": false,
"asks": false,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"simple": "You give Claude a job.",
"unaskedSave": false,
"director": "Prompt · 9 words",
"balloon": "Reply with just the word ok, use no tools.",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 1
},
{
"kind": "complete",
"ok": null,
"story": "Done in 3 seconds.",
"simple": "Done in 3 seconds. No files changed.",
"unaskedSave": false,
"director": "turn_duration · 3 s · 0 tool calls",
"balloon": "ok",
"tests": null,
"roundsOk": null,
"printed": null,
"events": 0
}
]
}
]