Jev 在分类器评测中质量与速度均胜出
Malte Ubl 将 TypeSafe AI 的 Jev 用于现有分类器评测,结果在质量上饱和评测集,速度比 Gemini 2.5 Flash Lite 快 6 倍。
用户展示JEV处理6,030条买家问答和1,005家YC公司名称检查,共37,636个判定、910万token,耗时40秒、花费0.38美元,远低于Claude Sonnet的36美元。
JEV is INSANE It read 6,030 ChatGPT answers to buyer questions about 1,005 YC companies and checked every company name in every answer. 37,636 verdicts. 9.1M tokens. 40 seconds. $0.38. Grading the same 6,030 answers with Claude Sonnet cost me $36 last month. 71% of these