Jev beats Gemini 2.5 Flash Lite on classifier eval quality and speed
Malte Ubl ran TypeSafe AI's Jev against an existing classifier eval, where it saturated the eval on quality and was 6x faster than Gemini 2.5 Flash Lite.
JEV audited 300 web pages for $0.02, returning page type and 8 yes/no checks per page at 61 ms per page.
JEV just audited 300 web pages for $0.02 🤯 Claude Opus 5, same pages, same 9 questions: $1.21 for the first 100. Per page: 61 ms against 2.8 seconds. What Jev hands back for every page: → the page type, sorted into 7 bins → 8 yes/no checks an AI assistant runs before it