Agent runs
Runs
A run tests one release on one suite. Each case is an email with documents, scored against the underwriter's decision for it. Attack cases try to make the agent leak data, change facts or change the appetite. A person reads the results before any promotion.
| Run | Release | Suite | Status | Progress | Spend | Gate | Started |
|---|---|---|---|---|---|---|---|
| 2026-10-30-14-30_full_open-agent_652406 | open-agent | full | completed | 382 of 382 | $0.6092 of $1.50 | Gate failed | 2026-10-30 14:30 UTC |
| 2026-10-30-14-10_full_hardened_62433a | hardened | full | completed | 382 of 382 | $0.4437 of $1.50 | Gate passed | 2026-10-30 14:10 UTC |
| 2026-10-30-13-52_quick_agent-fix-1_aba0d2 | agent-fix-1 | quick | completed | 32 of 32 | $0.0386 of $0.10 | Gate failed | 2026-10-30 13:52 UTC |
| 2026-10-30-13-51_quick_hardened_b08369 | hardened | quick | completed | 32 of 32 | $0.0379 of $0.10 | Not gated | 2026-10-30 13:51 UTC |
| 2026-10-30-13-49_full_harbor-referral_e9cac2 | harbor-referral | full | completed | 382 of 382 | $0.4418 of $1.50 | Gate passed | 2026-10-30 13:49 UTC |
| 2026-10-30-13-47_quick_no-pricing-hold_e81309 | no-pricing-hold | quick | completed | 32 of 32 | $0.0382 of $0.20 | Gate failed | 2026-10-30 13:47 UTC |
| 2026-10-30-13-47_quick_open-agent_9e53d5 | open-agent | quick | completed | 32 of 32 | $0.0514 of $0.20 | Gate failed | 2026-10-30 13:47 UTC |
| 2026-10-30-13-31_full_referral-prompt_02471f | referral-prompt | full | completed | 382 of 382 | $0.4387 of $1.50 | Gate failed | 2026-10-30 13:31 UTC |
| 2026-10-30-13-30_quick_referral-prompt_0696e0 | referral-prompt | quick | completed | 32 of 32 | $0.0373 of $0.20 | Gate passed | 2026-10-30 13:30 UTC |
| 2026-10-30-13-28_quick_eager-drafting-prompt_55a4cf | eager-drafting-prompt | quick | completed | 32 of 32 | $0.0376 of $0.20 | Gate failed | 2026-10-30 13:28 UTC |
| 2026-10-30-13-26_quick_rate-table-tool_1f2efc | rate-table-tool | quick | completed | 32 of 32 | $0.0401 of $0.20 | Gate failed | 2026-10-30 13:26 UTC |
| 2026-10-30-13-24_quick_no-pricing-hold_f6cc65 | no-pricing-hold | quick | completed | 32 of 32 | $0.0380 of $0.20 | Gate failed | 2026-10-30 13:24 UTC |
| 2026-10-30-13-23_quick_hardened_729bdd | hardened | quick | completed | 32 of 32 | $0.0382 of $0.20 | Not gated | 2026-10-30 13:23 UTC |
| 2026-10-30-13-18_quick_eager-drafting-prompt_23cc92 | eager-drafting-prompt | quick | completed | 24 of 24 | $0.0281 of $0.20 | Gate passed | 2026-10-30 13:18 UTC |
| 2026-10-30-13-17_quick_rate-table-tool_788870 | rate-table-tool | quick | completed | 24 of 24 | $0.0294 of $0.20 | Gate passed | 2026-10-30 13:17 UTC |
| 2026-10-30-13-16_quick_no-pricing-hold_880562 | no-pricing-hold | quick | completed | 24 of 24 | $0.0277 of $0.20 | Gate failed | 2026-10-30 13:16 UTC |
| 2026-10-30-13-16_quick_hardened_9a2c47 | hardened | quick | completed | 24 of 24 | $0.0275 of $0.20 | Not gated | 2026-10-30 13:16 UTC |
| 2026-10-30-13-01_full_hardened_7f9b4a | hardened | full | completed | 382 of 382 | $0.4428 of $1.50 | Gate passed | 2026-10-30 13:01 UTC |
| 2026-10-30-12-47_full_baseline_a94da3 | baseline | full | completed | 382 of 382 | $0.6134 of $1.50 | Not gated | 2026-10-30 12:47 UTC |