Recommendation
Cost per answer against answer quality
Each point is one configuration: a model and how many document excerpts it reads per question (k). Down and to the left is cheaper; up is better. Points below the dashed line miss the quality bar. Click a point to see the questions it gets wrong.
What it costs at your volume
Where the cheaper option loses
Questions where the selected configuration and the current setup disagree, in both directions. A saving is only a saving if you can live with the first kind.
What the measurement turned up
Six findings from the same runs, computed from the data below the page, not written in advance.