Files
Codeman/test/fixtures/story-corpus/bash-script-background-helper.expected.json
T
Codeman maintainer f464548541 test(story-mode): real sessions as a regression corpus
Nine transcripts from the review rounds, each a real Claude Code worker
building a small program (a Python CLI with a fix loop, a web page with
node:test, a bash script with a background helper, a long turn with a
prompt added mid-turn, teammates then an interrupt, a question then tests
first then a push, a text plan with a scratch dry run, /compact then plan
mode, a test failed on purpose). Each is cut down to the lines and fields
the reducer reads, with every path, user name and email rewritten and the
file contents of Reads left out; replaying them before and after gives
the same pages.

The expected file beside each pins every page (panel kinds, captions,
balloons, counts), so a change that alters a story fails with a diff of
exactly what changed; STORY_CORPUS_UPDATE=1 regenerates them. The beats
the reviews were about are also stated outright.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-18 11:45:41 +02:00

201 lines
5.9 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
[
{
"prompt": "First write a short todo list for this job, then build a bash script rename_by_date.sh in this folde",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 121460,
"toolCalls": 14,
"filesChanged": 2,
"added": 96,
"removed": 3,
"helpers": 1,
"helpersRunning": 0,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"director": "Prompt · 65 words",
"balloon": "First write a short todo list for this job, then build a bash script rename_by_date.sh in this folder that renames *.jpg files to their modification time as YYYY-MM-DD_HHMMSS.jpg with a --dry-run flag, and while you do…",
"tests": null,
"events": 1
},
{
"kind": "plan",
"ok": null,
"story": "Claude writes a plan: 5 steps.",
"director": "written as text · 5 steps",
"balloon": null,
"tests": null,
"events": 1
},
{
"kind": "investigate",
"ok": null,
"story": "Claude reads 1 file to find its way around.",
"director": "Bash ×2 · ls -la && git log --oneline | head; which shellcheck; bash…",
"balloon": null,
"tests": null,
"events": 2
},
{
"kind": "backup",
"ok": null,
"story": "Claude calls in 2 helpers.",
"director": "Advisor · Agent · advisor + general-purpose · 6 calls inside",
"balloon": null,
"tests": null,
"events": 2
},
{
"kind": "fix",
"ok": null,
"story": "Claude changes 2 files.",
"director": "Write · Edit ×3 · Bash · rename_by_date.sh +95 −3 · -dash.jpg +1",
"balloon": "Now I'll create the samples and run the dry run.",
"tests": null,
"events": 5
},
{
"kind": "run",
"ok": null,
"story": "Claude works in the terminal.",
"director": "Bash ×5 · rm -- ./-- && S=/tmp/claude/-work-cases-story-review-c/740e…",
"balloon": "My mk -- ... helper call left a stray file named --.",
"tests": null,
"events": 5
},
{
"kind": "complete",
"ok": null,
"story": "Done in 2 minutes.",
"director": "turn_duration · 2 min 1 s · 14 tool calls · 2 files changed · 1 helper",
"balloon": "All the script tests pass.",
"tests": null,
"events": 0
}
]
},
{
"prompt": "Agent \"Write README for rename script\" finished",
"origin": "task",
"complete": true,
"interrupted": false,
"durationMs": 20696,
"toolCalls": 2,
"filesChanged": 0,
"added": 0,
"removed": 0,
"helpers": 1,
"helpersRunning": 0,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "A background job reports back.",
"director": "Prompt · 7 words · task",
"balloon": "Agent \"Write README for rename script\" finished",
"tests": null,
"events": 1
},
{
"kind": "investigate",
"ok": null,
"story": "Claude reads 1 file to find its way around.",
"director": "Read",
"balloon": null,
"tests": null,
"events": 1
},
{
"kind": "run",
"ok": null,
"story": "Claude works in the terminal.",
"director": "Bash · mkdir -p \"$S/ro\" && printf x > \"$S/ro/q.jpg\" && chmod a-w \"…",
"balloon": "The README matches the script.",
"tests": null,
"events": 1
},
{
"kind": "complete",
"ok": null,
"story": "Done in 21 seconds.",
"director": "turn_duration · 21 s · 2 tool calls · 1 helper",
"balloon": "I built rename_by_date.sh, the helper agent wrote README.md, and the script passed every test I ran on sample files in samples/.",
"tests": null,
"events": 0
}
]
},
{
"prompt": "Add a --prefix option to rename_by_date.sh that puts a given text in front of the new names, and sho",
"origin": "human",
"complete": true,
"interrupted": false,
"durationMs": 73724,
"toolCalls": 9,
"filesChanged": 2,
"added": 39,
"removed": 8,
"helpers": 0,
"helpersRunning": 0,
"panels": [
{
"kind": "mission",
"ok": null,
"story": "You give Claude a job.",
"director": "Prompt · 26 words",
"balloon": "Add a --prefix option to rename_by_date.sh that puts a given text in front of the new names, and show me a dry run on the samples.",
"tests": null,
"events": 1
},
{
"kind": "investigate",
"ok": null,
"story": "Claude reads 1 file to find its way around.",
"director": "Read",
"balloon": null,
"tests": null,
"events": 1
},
{
"kind": "fix",
"ok": null,
"story": "Claude changes 1 file.",
"director": "Edit ×3 · rename_by_date.sh +21 −6",
"balloon": null,
"tests": null,
"events": 3
},
{
"kind": "run",
"ok": null,
"story": "Claude works in the terminal.",
"director": "Bash ×2 · bash -n \"$P/rename_by_date.sh\" && echo \"syntax ok\"",
"balloon": "Here's the dry run you asked for on the samples, plus a check that nothing on disk changed:",
"tests": null,
"events": 2
},
{
"kind": "fix",
"ok": null,
"story": "Claude changes 1 file.",
"director": "Edit ×3 · README.md +18 −2",
"balloon": "All passing.",
"tests": null,
"events": 3
},
{
"kind": "complete",
"ok": null,
"story": "Done in 1 minute.",
"director": "turn_duration · 1 min 14 s · 9 tool calls · 2 files changed",
"balloon": "I added a --prefix option to rename_by_date.sh.",
"tests": null,
"events": 0
}
]
}
]