Agent Vigil value comparison

Comparable records

12 unique changes · 0 replaced records · 1 comparable task classes

synthetic-bugfix

demo-agent-a

demo-model-a

Sample
6 changes
Positive records
83.3% 95% range 43.6%–97.0%
Cost records
100.0% complete $1.32 per positive record
Later problems
1

synthetic-bugfix

demo-agent-b

demo-model-b

Sample
6 changes
Positive records
66.7% 95% range 30.0%–90.3%
Cost records
100.0% complete $1.27 per positive record
Later problems
2

Limits and warnings

Generated locally by Agent Vigil. The 95% ranges show sampling uncertainty. They do not remove task-selection bias or prove that an agent caused the outcome.