Virtual Trial
Repo
Judge modeEach section shows the criterion it speaks to and a link to the evidence.Full evidence map

For judges

Every claim, with its evidence

Each row links a claim to something you can open without signing in. 23 of 24 are live today; rows marked "in progress" will link to evidence before submission.

Repository: gitlab.com/gitlab-ai-hackathon/transcend-october-2026/4656288/virtual-trial-oref0. Built on OpenAPS oref0 (MIT).

Technological implementation

ClaimEvidenceStatus
oref0 runs as a deployed dosing engine, built from this repository's lib/Live engine health and versionLive
Every engine release is a canary: no traffic until 151 decisions pass the safety envelope, checked again after promotionDeploy job log (search for PASSED)Live
GitLab CI deploys to Google Cloud with no stored keysWorkload Identity Federation (infra/wif.tf)Live
All Google Cloud infrastructure is codeTerraform in infra/Live
Security scans on every merge request and on masterPipeline: SAST, secret detection, dependency scanningLive
oref0's own tests run on every change; any new failure blocksTest report: 234 passing, 9 known upstream failures, 0 newLive
Uptime checks and alerts on everything judges openCloud Monitoring config (infra/monitoring.tf)Live
Closed-loop trial on every merge request: base and head oref0 dose the same virtual patientsTrial and gate jobs in the master pipelineLive
Ten virtual patients live on the deployed engine around the clockLive clinic pageLive
Two GitLab Duo flows plan trials and explain verdicts, started by a mention, published in the AI CatalogFlow definitions (.gitlab/duo/flows/)Live
Agents cannot change dosing code, the trial, or the gate limits, enforced by the pipelineAgent boundary check (ci/agent_boundary.py)Live
Eight scenarios, five of them faults modeled on real bugs and recallstrial/scenarios.pyLive
The gate blocks small but consistent harm with a paired exact sign test, in both directionsgate/thresholds.yamlLive

Design

ClaimEvidenceStatus
A risky engine release is stopped before anyone is servedSeeded bug (safety cap 3 to 6) blocked: 25 of 151 decisions above the limitLive
One click rolls the engine back to the previous versionrollback-engine job (infra/ci/deploy.gitlab-ci.yml)Live
One merge request tells the whole story: plan, trial, verdict, explanationDemo MR !10: the plan agent's note and label, the 6-shard trial, the gate's BLOCKED summary, and the explain agent's noteLive

Potential impact

ClaimEvidenceStatus
Software changes to diabetes devices have hurt peopleFDA recall notices and studiesLive
The existing tests on this real dosing code were already failing and ignoredKnown upstream failures, each with its reasonLive
A seeded dosing bug (max insulin on board x4) is blocked by the trial in a real pipelineGate job log: BLOCKED, low blood sugar risk +30% in 222 of 300 matched runsLive
Virtual Trial catches harmful dosing changes that today's checks miss, without flagging harmless onesBenchmark: 14 seeded changes, four checksLive

Innovation

ClaimEvidenceStatus
A clinical trial as a pipeline stageHow it worksLive
Agents may test but never touch dosing codeSafety pageLive

Presentation

ClaimEvidenceStatus
Anyone can ask the deployed engine for a decisionTry it pageLive
Demo video under 3 minutesYouTubeIn progress