Keeping the record when an agent run fails
Preserving failed attempts and partial trajectories, then preparing the next step toward batch execution.
Read note : Keeping the record when an agent run failsAccounts of what I am building, the decisions along the way, and what the results show.
Project · In progress
A tutorial-based agent implementation, developed step by step toward a complete SWE-bench evaluation.
Current stage: Recording failed attempts and implementing the batch runner.
View project overview →Dated entries about individual work sessions.
Preserving failed attempts and partial trajectories, then preparing the next step toward batch execution.
Read note : Keeping the record when an agent run failsAdding a separate evaluation command, preserving distinct failure states, and getting the first resolved result from the SWE-bench harness.
Read note : Scoring the first saved agent patchRecording individual model messages, guarding against an exit before execution, and checking what a single-task result actually establishes.
Read note : Finding premature exits in the saved agent tracesCapturing changes before container cleanup, saving trajectories, and finding a failure in the final summary.
Read note : Keeping the patch and the record of a runLoading configuration once, keeping prompt values consistent with execution, and separating build history from current code.
Read note : Moving run settings into one configurationSeparating command execution from the agent loop, working through timeouts and cleanup, and checking the single-task runner.
Read note : Building the execution environment for my minimal agent