Jev 在分类器评测中质量与速度均胜出
Malte Ubl 将 TypeSafe AI 的 Jev 用于现有分类器评测,结果在质量上饱和评测集,速度比 Gemini 2.5 Flash Lite 快 6 倍。
作者构建了一个系统,通过 Jev API 向 150 个虚构人设各发送 12 个问题,询问其产品采用意向。实际成本 1.8 日元,耗时约 5 秒,速度足够快但包含延迟。
I built a system to ask 150 fictional personas on the trending Jev about their product adoption intent. It throws 12 questions via API for each of the 150 personas. The actual cost was 1.8 yen, and the time taken was about 5 seconds. It's plenty fast, but it includes latency