Immutable plans
Bind cases, models, attempts, source identities, and constraints before execution.
Evaluation evidence / longitudinal comparison · v0.1.0-rc.7
YYLO Benchmark validates immutable plans, runs isolated attempts, governs grading, reconciles evidence, and produces bounded reports without hiding source artifacts.
Supplementary visual overview
Product behavior and commands are defined by the verified HTML documentation; this artwork provides a high-level visual summary.
Open full-size image
Install / first run
Install the synchronized release, then begin with a change small enough to validate and review.
Available today / mechanisms
Bind cases, models, attempts, source identities, and constraints before execution.
Keep candidate runs independent and retain execution and cost provenance when available.
Use pinned graders and blinded evaluation rather than untraceable model preference.
Reconcile durable intent, recover safely, and compare retained evidence over time.
Product direction / clearly separated
Benchmark evidence is designed to help teams learn which agent and workflow works best for a repository and change type. Automatic production workflow selection requires connected real-world outcome history and is not a current-release claim.