
Harness Creator
FreeBuild reliable harnesses for AI coding agents.
Free · Opens the source repo
What Harness Creator does
Harness Creator is a specialized tool designed to help developers create, audit, and improve harnesses that enhance the reliability of AI coding agents. By focusing on key subsystems, this skill ensures that agents start correctly, stay within their defined scope, verify their work, and can seamlessly resume tasks across sessions. The skill is particularly useful for those who work with coding agents that may struggle with context retention, scope management, or consistency across interactions.
The core functionality of Harness Creator revolves around five essential subsystems: instructions, state, verification, scope, and lifecycle. Each subsystem plays a critical role in defining how an agent operates and assesses its own progress. For example, the instructions subsystem utilizes files like AGENTS.md or CLAUDE.md to outline the agent's operational rules, while the state subsystem tracks the current feature and status using feature_list.json and progress.md. This structured approach helps prevent common pitfalls such as overreach or incomplete tasks.
Users can leverage the bundled scripts to create a new harness or audit an existing one. The create-harness.mjs script allows for quick setup, while the validate-harness.mjs script provides a scorecard for each subsystem, helping users identify areas for improvement. Additionally, users can generate reports to share assessments of their harnesses, providing a clear overview of the agent's performance and reliability.
Harness Creator is ideal for developers and designers working with AI coding agents who need to ensure consistent performance and reliability. Whether you are creating new harnesses or refining existing ones, this skill provides the necessary tools and structure to enhance your agents' capabilities.
When to use it
Use Harness Creator when developing or refining harnesses for AI coding agents that require consistent performance and context retention.
When not to use it
This skill is not suitable for tasks related to model selection, prompt tuning in isolation, or general application architecture.
What you can build with it
Creating a New Harness
Use the `create-harness.mjs` script to quickly set up a new harness for your AI coding agent, ensuring it has the necessary structure to perform reliably.
Auditing Existing Harnesses
Run the `validate-harness.mjs` script to assess the reliability of an existing harness, identifying areas for improvement based on subsystem performance.
Generating Performance Reports
Utilize the `render-assessment-html.mjs` script to create shareable reports that provide insights into the performance and reliability of your AI coding agents.
How to install Harness Creator
View source1. Install with the skills CLI
npx skills add walkinglabs/learn-harness-engineering/harness-creator --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by walkinglabsHarness Creator
Use this skill to make a repository easier for coding agents to start, stay in scope, verify work, and resume across sessions. Keep the harness small enough that agents actually follow it.
Not for model selection, prompt tuning in isolation, chat UI design, or general app architecture.
Core Model
Every useful coding-agent harness has five subsystems:
| Subsystem | Minimal artifact | Purpose |
|---|---|---|
| Instructions | AGENTS.md or CLAUDE.md | Startup path, working rules, definition of done |
| State | feature_list.json, progress.md | Current feature, status, evidence, next step |
| Verification | init.sh or documented commands | Tests/checks the agent must run before claiming done |
| Scope | Feature dependencies and done criteria | Prevents overreach and half-finished work |
| Lifecycle | session-handoff.md, end-of-session routine | Makes the next session restartable |
First Move
- Inspect what already exists: instruction files, feature/state files, verification commands, docs, package manifests.
- Ask only for missing context that cannot be inferred safely: target agent, desired file name, tolerance for structure, and whether overwriting is allowed.
- Prefer a minimal harness first. Add memory, tool safety, multi-agent, or benchmark details only when the user's problem calls for them.
Common Tasks
Create a harness
Use the bundled script when working on a local repository:
node skills/harness-creator/scripts/create-harness.mjs --target /path/to/project
Options:
--agent-file CLAUDE.mdfor Claude-oriented projects.--package-manager npm|pnpm|yarn|bunwhen detection is wrong.--commands "cmd one,cmd two"for custom verification.--forceonly after confirming overwrites are acceptable.
Then explain what was created and how the user should replace placeholder feature entries.
Audit an existing harness
Run:
node skills/harness-creator/scripts/validate-harness.mjs --target /path/to/project
Report the five subsystem scores, the lowest-scoring area, and the first 2-3 changes that would improve reliability. Treat the lowest score as a candidate bottleneck; confirm with failures, logs, or task outcomes before claiming causality.
Produce a report
Use when the user wants a shareable assessment:
node skills/harness-creator/scripts/render-assessment-html.mjs --target /path/to/project
node skills/harness-creator/scripts/run-benchmark.mjs --target /path/to/project --html /path/to/report.html
Be clear that this is a structural benchmark. The benchmark first runs a self-check — it scaffolds a throwaway harness and validates it, proving the bundled scripts work end-to-end — then scores the target and eval coverage. Real effectiveness still needs before/after agent sessions on representative tasks.
When to Read References
Load only the reference needed for the user's problem:
- Memory across sessions: Memory Persistence
- Reusable workflows as skills: Skill Runtime
- Permissions, tools, concurrency: Tool Registry & Safety
- Context budget and progressive disclosure: Context Engineering
- Delegation and parallel agents: Multi-Agent Coordination
- Hooks, startup, long-running work: Lifecycle & Bootstrap
- Non-obvious failure modes: Gotchas
Design Rules
- Keep the root instruction file short: routing and invariants, not a full manual.
- Put project facts in project docs, not in the skill.
- Make verification commands explicit and runnable.
- Require evidence before marking a feature done.
- Use one active feature unless the harness has explicit multi-agent ownership boundaries.
- Prefer append/update state files over relying on chat history.
- Never hide destructive behavior in scripts; overwrites require explicit user approval.
Deliverable Checklist
For a usable minimal harness, leave the target project with:
-
AGENTS.mdorCLAUDE.md -
feature_list.json -
progress.md -
init.sh - Optional
session-handoff.mdfor multi-session work - Documented verification evidence or next action
If you cannot create files, provide exact file contents and commands instead.
Frequently asked questions about Harness Creator
Similar skills
Skill Creator
Efficiently create and manage skills for Gemini CLI.
Agent Development
Create and manage autonomous agents for Claude Code.
Math Olympiad Solver
Solve and verify competition math problems effectively.
Microsoft Skill Creator
Create specialized skills for Microsoft technologies.
Doublecheck
A verification pipeline for AI-generated claims.
Skill Development for Claude Code
Create and enhance skills for Claude Code plugins.
