Back to explore

Jev vs Claude för support: 46x billigare

I Ballet's utvärderingsagenttest med 1 998 komplexa supportmeddelanden kostade Jev 0,095 USD och 110 sekunder jämfört med Claude Sonnet 5:s 4,34 USD och 220 sekunder. Sonnet var ungefär 1 poäng mer exakt, men Jev var 46 gånger billigare.

Same 1,998 complex support messages. Same three questions. @typesafeai Jev: $0.095 and 110 seconds. @AnthropicAI Claude Sonnet 5: $4.34 and 220 seconds. Sonnet was about 1 point more accurate. Jev was 46× cheaper. That decision is what Ballet's evaluation agent does. It

· 0 likesOpen on X