<!-- GENERATED by tools/gen-md-twins.py from index.html. The HTML page is authoritative; if this file disagrees with it, this file is stale. -->
# OneDroid Argus — Independent Testing at the Cost of AI Coding

> Independent testing of AI-built software now costs about what the AI coding costs. OneDroid Argus runs acceptance scenarios your coding agent never saw and returns a verdict backed by evidence you can replay.

Canonical: https://onedroid.ai/

OneDroid Argus · independent testing for AI-built software

# Proper testing now costs what the AI coding costs.

So there is no longer a reason to skip it.

Companies used to spend a fifth to a third of their IT budget on testing (Capgemini's
World Quality Report), so testing was the part that got cut. Coding agents changed the
price of both. In one measured experiment, Claude Code built a feature for $1.97 a run
testing its own work. With OneDroid Argus as an independent tester, the coding agent cost
$1.01 a run, and the tester wrote checks the coding agent never saw in one session of
about $5.30 for the feature, $1.77 a run over three runs.
The experiment, its figures and its limits.

OneDroid Argus runs acceptance scenarios your coding agent never saw, against the build it
just handed you, and returns a verdict backed by cryptographic evidence you can
replay yourself.

Talk to us
See a verdict

The runner runs inside your environment, and its source is open under MIT. No credit card.

agent loop  →  saga under load, in your environment  →  one verdict: green · red · orange  →  written to the cryptographic ledger, then continuous

verdict log
illustrative

Holdout acceptance. Scenarios sealed before the first line of code, run once against a pinned build.

Under load. The same scenarios under load, against a message broker or an HTTP target; on an HTTP target a stepped ramp finds its limit.

Continuously. Once it passes, it goes on a schedule, every 15 minutes at the shortest, and one page answers “Is it OK?”.

Evidence anyone can replay. The withheld scenario set is hashed and
written to a cryptographic ledger before the build starts. After the verdict, every scenario
is revealed — trigger, expectation, observed reality — and the runner
replays any of them against the same build. You never have to take our word for the
verdict. How the seal and the custody work.

## 50,000 lines overnight. How do you know what it did?

Nobody reads all of it. You can hold it to what it was supposed to do, with checks it
never saw. Two things make that answer worth trusting.

The builder can't game checks it never sees. A model that can see its
checker learns to satisfy the checker. OneDroid Argus seals the checks before the work
starts. The builder, a person or an AI agent, holds a credential that can ask for a run and
read the verdict, and cannot read a check or an expected value.

Every verdict comes with its boundary. The reveal lists every check that
was run. The certificate says what it proves and what it does not, for instance whether the
running build was measured. Our case studies also list what was not tested. A pass without
its boundary is only a claim.

Shown on real code: a decades-old Fortran library
held to its own user guide, 100 sealed checks, each quoting the sentence it tests. 91 held,
9 failed, every check was shown able to fail, and the page lists what the result does not prove.

It solves the problem, and it is affordable. In
one measured experiment the coding agent
built a feature for $1.01 to $1.97 a run, and the independent tester was one session of about
$5.30 for the whole feature. Independent testing now costs the same order as the AI coding.

## You already had the incident.

80% have traced a production incident directly back to AI-generated code,
and 92% aren't confident their current safeguards would catch an AI-driven
failure before it reaches users.
Sauce Labs, “The Enterprise AI Code Verification Crisis”, n = 400 US executives and
engineering leaders, 22 July 2026 — a vendor-commissioned survey. (AS-9 §2, fetched
2026-09-10.)

3.1% of developers highly trust AI output; 19.6% highly distrust it; 66% hit
answers that are “almost right, but not quite”.
Stack Overflow Developer Survey 2025, n = 33,244. (AS-9 §2, fetched 2026-09-10.)

Syntax pass rates for AI-generated code climbed from about 50% to 95%. Security
pass rates stayed flat, between 45% and 55%.
Veracode, Spring 2026 GenAI Code Security update, 150+ models across 80 coding tasks,
24 March 2026. (AS-9 §2, fetched 2026-09-10.)
Capability is improving. Correctness under adversarial check is not.

And the tools that read the diff have stepped back from the verdict on purpose: Claude
Code Review's check “always completes with a neutral conclusion so it never blocks
merging”; Copilot's reviews “do not count toward required approvals”.
(Vendor documentation, AS-9 §1 and §5, fetched 2026-09-10.)
OneDroid Argus returns a verdict: passed or failed, never neutral.

How it works

## Three steps, and the middle one is the point.

01

### Your agent writes the scenarios

You state the intent — the ticket, the acceptance criteria, the interface diff.
Your own agent, with our skill, turns that into a scenario set: the happy path,
the repeat, the wrong actor, the wrong state, every external call's failure, the race
at the shared resource, and the load variant. The control plane seals the set and
anchors its hash before a line of code is written.

02

### The builder never sees the answer key

The coding agent never holds a token that can read the expectations, and the
scenarios are never in its working directory. It builds against reality, not an answer
key. It can run the scenarios as often as it likes and see only what happened — never
what was expected.

03

### The verdict, with evidence

One final run against a pinned build, then the reveal: every scenario, its trigger,
its expectation, the observed evidence, and the verdict — as a report a reviewer can
hand to an auditor, and a certificate anyone can check offline. The scenarios become
regression guards; the next feature gets a fresh withheld set.

Three modes, one evidence contract

## One product, three questions.

### Holdout acceptance — “does it do what was asked?”

Withheld scenarios, run once against a pinned artefact: a verdict plus per-scenario
replayable evidence.

### Under load — “how much can it take?”

A scenario declares its load and the latency and error rate it must stay under.
For message brokers, a ramp of sessions in steps finds the limit and records what
was sent, confirmed and delivered at each step. An HTTP target can be ramped step
by step too. No ramp drives a web page in a browser.

### Continuously — “is it still true tomorrow?”

The reviewed scenario set runs on a monitor schedule, every 15 minutes at the
shortest. One page answers “Is it OK?” from the scheduled runs only, and lists what
needs a person.

All three in detail, and what OneDroid Argus is not.

The run layer

## It brings its own run layer.

OneDroid Synapse is the governed MCP gateway OneDroid Argus reaches its control
plane through. Your agents connect to one URL instead of holding credentials for each
service; every tool call is authenticated, policy-checked, and written to an append-only
audit log you own. It ships with OneDroid Argus and runs standalone.
How Synapse works

OneDroid Engram is versioned knowledge and memory in a Postgres you
control — hybrid vector, keyword and graph search, git-style history, diff and restore.
OneDroid Argus keeps the scenario corpus there, so the evidence
behind a verdict has a history, not just a timestamp.
How Engram works

The method behind the gate is written down and open: the Dark Factory kits, Apache-2.0.

For regulated buyers

## When someone has to answer for it.

OneDroid Argus, Synapse and Engram on your own infrastructure, held together by one thing: the
evidence record. Synapse's audit entry, Engram's versioned fact and OneDroid Argus's verdict are
the same object — a promise plus the evidence for it. Where the law names the pieces they
line up: EU AI Act Art. 12 (automatic recording of events over the lifetime of the system)
and Art. 14 (human oversight) for high-risk AI products; DORA Art. 25 and
Art. 30; HIPAA 164.312(b); FDA 21 CFR 11.10(e). Using a coding agent does not by itself
make your system high-risk, and we will not tell you otherwise.

Worth knowing: the largest vendor's hosted agents say of themselves that they are “not
currently eligible for Zero Data Retention (ZDR) or HIPAA Business Associate Agreement
(BAA) coverage.” (Vendor documentation, AS-10 via strategy §6b, fetched 2026-09-10.)
If that is your world, start here.

Bring us your security review
Financial services

Open source

## Open where it has to be.

github.com/OneDro1d
open source

The Dark Factory kits are open source under Apache-2.0, at the address above. The
OneDroid Argus runner executes inside your environment and touches your data plane, so its
source is open too, under MIT:
github.com/OneDro1d/argus-runner.
The generator that derives the withheld scenarios and adjudicates the verdict is
hosted and closed. The holdout is provably prior, and the evidence is replayable with the
runner in your own environment. A certificate proves what the runner reported and when,
not that the runner was unmodified.

The OneDroid org on GitHub
Read the kits

FAQ

## Questions people actually ask.

### What is OneDroid Argus?

A verifier for AI-built software. It runs acceptance scenarios your coding agent never saw against the system it built, under load as well as once, and returns a verdict with evidence you can replay.

### How is this different from an AI code reviewer?

A reviewer reads the diff and gives an opinion. OneDroid Argus never reads the diff — it exercises the running system. A reviewer says “this looks wrong”; OneDroid Argus says “when I cancelled a shipped order, you refunded it”, and shows you the saga.

### What does independent testing cost?

The same order as the coding. In one measured experiment, Claude Code built a feature for $1.97 a run testing its own work; with OneDroid Argus as the independent tester, the coding agent cost $1.01 a run and the tester one session of about $5.30 for the feature ($1.77 a run over three runs), and both setups passed all 13 hidden checks. The tester is paid once per feature, and its checks stay as regression checks. One ticket and three runs per setup, so treat it as one data point. The case study.

### Do I have to trust your closed generator?

No. The scenario set is hashed and anchored before the build, revealed in full afterwards, and any scenario can be replayed by the runner. The anchor proves the scenarios were prior and unchanged; keeping them unseen is custody — a builder credential that cannot read a test, and an environment that does not hold one.

### Where does it run?

Next to your system, inside your environment, and on the owner's terms. A monitor can watch a live system; for an app that moves money, one switch makes OneDroid Argus refuse every write the owner has not listed, with limits. Database access is read-only, and a load ramp never targets a live broker.

### Does OneDroid Argus score my build?

No. Every scenario ends as passed, failed or errored, and an error is never a pass. The verdict is a decision about one pinned build against the sealed scenarios, with the evidence attached. There is no number to optimise for and no “safe” label.

## Find out what your agent actually built.

Talk to us
Get started

The OneDroid Argus runner is free and open source under MIT; the control plane by request. Email
michal@onedroid.ai —
you'll reach Michal Bacia, the team that builds the product, not a sales queue.
We reply within one business day.
