Skip to content

Topic

Agent Harnesses

Software scaffolding that wraps an AI model with context, tools, and task constraints, shaping what an agent can do beyond the base model's abilities.

Current stories

buildOne report1 publisher

Ruflo's 100-agent swarm for Claude Code starts in read-only mode with approval switched on

Cognitum One released a new Ruflo on October 13 that turns one coding assistant into a swarm of 100+ agents. The parts worth copying are the controls around the model: approval modes, cost visibility and data gating.

Publishers:dev.to

Reality

Evidence25
Adoption55
Hype gap+30
Incentives70
Confidence55
buildOne report1 publisher

Kubernetes creators' Mecatl harness splits the coding-agent loop from its tools and session state

Kubernetes creators Craig McLuckie and Joe Beda's startup Stacklok is building Mecatl, a coding-agent harness designed to run in the cloud. It pulls tool calls, session state and memory out of the agent loop so each can be put into systems an operator can manage.

Publishers:latent.space

Reality

Evidence35
Adoption
Not scored
Hype gap+20
Incentives75
Confidence40
buildOne report1 publisher

Google's RRSI gives up training points to keep self-rewritten agent harnesses general

Google Cloud AI Research's RRSI lifted agent scores up to 4.7 points on five unseen benchmarks by capping how far a harness can rewrite itself. Its guardrails cost points on the tuning tasks, a trade worth making for teams that need harness gains to hold on new work.

Publishers:the-decoder.com

Reality

Evidence45
Adoption8
Hype gap+10
Incentives
Not scored
Confidence50
buildOne report1 publisher

Webwright lifts GPT-5.4 from 33.5% to 60.1% on long web tasks by having it write browser code

Microsoft Research's Webwright lifted GPT-5.4 from 33.5% to 60.1% on 200 long web tasks by having it write browsing code from a terminal. Because the baseline steered by screen coordinates, the result compares writing code with clicking pixels.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+25
Incentives60
Confidence45
buildConfirmed3 publishers

Matthew Schwartz credits 15 new physics integrals to a harness that keeps Claude on bounded, checkable tasks

Harvard physicist Matthew Schwartz says his BootLoops toolkit helped Claude finish 30 scattering-amplitude integrals, 15 of them never completed before. His examples show the harness keeps the math checkable while collaborators still decide which questions are worth computing.

Perspective Coverage

3 publishers
Builder
Builder 40%
Operator
Operator 42%
Investor
Investor 18%

Reality

Evidence40
Adoption10
Hype gap+15
Incentives60
Confidence55
buildOne report1 publisher

Pi Durable checkpoints every agent step so crashed runs resume from storage

Pi Durable ports the Pi agent harness to TypeScript and checkpoints every step to one of three stores, so crashed agents resume where they stopped. Whether it can replace hand-built resume code depends on how it treats a tool call cut off mid-flight.

Publishers:latent.space

Reality

Evidence28
Adoption
Not scored
Hype gap+30
Incentives
Not scored
Confidence35
securityOne report1 publisher

Claude Opus 4.6 cost 40 times as much as Gemini 3 Flash per run for 11 more points of pen-test coverage

Ridge Security's 96-test pen-test benchmark had Claude Opus 4.6 reach 63% coverage at $217 a run, against 52% for Gemini 3 Flash at about $5.42. Ridge argues tooling matters more than the model, yet its published runs held the tooling fixed and varied the model.

Reality

Evidence35
Adoption
Not scored
Hype gap+40
Incentives70
Confidence40
investOne report1 publisher

Google's open-source RRSI rewrites agent scaffolding to add six points on Terminal-Bench

Google Cloud AI Research has released RRSI, an Apache 2.0 tool whose self-rewriting agent harness lifted Terminal-Bench 2.1 scores from 74.2% to 80.2%. Any team can use it commercially, though on tasks the agent never trained against the reported gain falls to 4.7 points.

Reality

Evidence45
Adoption
Not scored
Hype gap+15
Incentives50
Confidence40
buildOne report1 publisher

Nvidia's SoL-Pi rewrites coding-agent harnesses to use up to 49 percent fewer tokens

Nvidia's SoL-Pi, an automated search over coding-agent harnesses, cut token use 44.7 to 49 percent at scores close to the Pi baseline. The gains were measured on 40 held-out tasks with a search fitted to one model, so they carry over only as far as a team's workload resembles that setup.

Publishers:the-decoder.com

Reality

Evidence52
Adoption
Not scored
Hype gap+15
Incentives
Not scored
Confidence50
buildOne report1 publisher

Ten stalled runs beside ten clean controls is what Verdict accepts as a reproduction

The harness hands the verdict to a pure reducer reading a run ledger, so the model can gather observations but cannot upgrade them. The cost is that your bug has to fit an approved command and a fixed budget.

Publishers:dev.to

Reality

Evidence45
Adoption5
Hype gap+15
Incentives45
Confidence55
productOne report1 publisher

Meta's product chief credits OpenClaw after users diffed Muse's SOUL.md

The copyable layer of a consumer agent turns out to be its scaffolding. Meta's head of product said as much in public after users compared Muse's config files with OpenClaw's. The open source licence makes that a product argument.

Publishers:thenextweb.com

Reality

Evidence74
Adoption70
Hype gap+12
Incentives66
Confidence68
productOne report1 publisher

NVIDIA Labs' SoL-Pi harness cuts coding-agent costs by up to $13.50 an hour versus native Codex and Claude Code

NVIDIA Labs says its SoL-Pi harness saves a researcher $8.75 to $13.50 an hour against native Codex and Claude Code. Of that, $4.36 to $5.71 comes from what its automated search added on top of the Pi harness.

Publishers:nvlabs.github.io

Reality

Evidence42
Adoption
Not scored
Hype gap+25
Incentives72
Confidence45
buildOne report1 publisher

Strands Harness keeps five subsystems local and routes one call to Bedrock

AWS has open-sourced a preconfigured general-purpose agent on top of its Strands SDK and says it runs 45% cheaper than Claude Code and Codex. The model call defaults to Amazon Bedrock, and Marc Brooker says one line changes that.

Publishers:thenewstack.io

Reality

Evidence50
Adoption15
Hype gap+25
Incentives78
Confidence45
scienceOne report1 publisher

UHP turns the choice of agent harness into a field in the request

The Unified Harness Protocol specifies how an application starts a task on an agent runtime, follows it, cancels it and collects the files, borrowing the shape of OpenAI's Responses API so existing streaming clients need no changes.

Publishers:unifiedharnessprotocol.org

Reality

Evidence32
Adoption
Not scored
Hype gap+35
Incentives62
Confidence52
buildOne report1 publisher

Swapping the harness under a fixed model kept pass rate within 8 points on 50 Terminal-Bench Pro tasks

A 300-trial study swapped Goose, OpenCode and OpenHands-SDK under Qwen 3.6 Plus and MiniMax M2.5, and reports that the scaffold sets tokens per solved task and the failure mode while the score barely moves.

Publishers:arxiv.org

Reality

Evidence52
Adoption
Not scored
Hype gap+20
Incentives30
Confidence58
buildOne report1 publisher

A 328-case benchmark traces injected instructions across seven kinds of agent-harness state

HarnessSafe, from Beijing University of Posts and Telecommunications with China Telecom and the Beijing Academy of Artificial Intelligence, reports that containment depends on which carrier holds the attacker's text and on which model is driving the harness.

Publishers:arxiv.org

Reality

Evidence44
Adoption
Not scored
Hype gap+15
Incentives40
Confidence55
productOne report1 publisher

Databricks finds the harness swings coding-agent cost more than the model does

The company benchmarked coding agents on real tasks against its own multi-million line codebase and found that per-token price predicted almost nothing about what a finished task cost. GLM 5.2 came in at $1.28.

Publishers:databricks.com

Reality

Evidence58
Adoption38
Hype gap+20
Incentives70
Confidence55

Earlier coverage