Scores
One row for each measure, over the normal cases in this experiment.
| Measure | Result | What it means |
|---|---|---|
| Field accuracy | 100.0% | Share of facts pulled from the documents that match the answer key. |
| Appetite agreement | 95.0% | Share of normal cases where the AI and the underwriter chose the same appetite, meaning whether the insurer wants the risk. |
| Accepted as is | 91.7% | Share of normal cases the underwriter could approve without an edit. |
| Corrections per case | 0.08 | Average number of edits an underwriter would make to one normal case. |
| Schedule within 2 points | 96.7% | Share of normal cases where the schedule change is within 2 points of the underwriter's. |
| Premium error, median | 0.6% | Typical gap between the AI's premium and the underwriter's premium. |
| Latency, median and 95th | 12.2 s and 15.8 s | Time from the submission arriving to the draft being finished. |