Jev beats Gemini 2.5 Flash Lite on classifier eval quality and speed
Malte Ubl ran TypeSafe AI's Jev against an existing classifier eval, where it saturated the eval on quality and was 6x faster than Gemini 2.5 Flash Lite.
After integrating Jev into Lightdash's data agents, a side-by-side comparison showed a 78% reduction in time and only 7% of the token usage. Full write-up coming soon and already rolling out to users.
We added jev into @lightdash_devs 's data agents and did a side-by-side comparison and the results were pretty epic. 78% reduction in time and only used 7% of tokens compared to without jev in the loop! Full write-up coming soon, and rolling out to users already :D