Jev 在分类器评测中质量与速度均胜出
Malte Ubl 将 TypeSafe AI 的 Jev 用于现有分类器评测,结果在质量上饱和评测集,速度比 Gemini 2.5 Flash Lite 快 6 倍。
作者将OpenAI新的Decisions API与Jev、Perplexity和Clef在1,565封电子邮件基准上进行了对比。结果显示Perplexity v1.1总体最佳,OpenAI最快,但置信度行为仍最引人注目。
I put OpenAI’s new Decisions API through the same 1,565-email benchmark I’ve been running on Jev, Perplexity and Clef. 6 models from 4 companies now. Perplexity v1.1 came out best overall 🚀 OpenAI was the fastest⏱️ But the confidence behavior is still the most interesting