Back to explore

Jev loses to Gemini on email classification benchmark, still considered for production

The author tested Jev on a benchmark of 1,565 German and English business emails from industrial suppliers across 10 categories, finding it less accurate than Gemini, but focused on where the errors occurred and still plans to put it into production.

Jev lost to Gemini on our email classification benchmark. I’m still interested in putting it into production. We tested 1,565 German and English business emails across 10 categories from Industrial suppliers. The interesting result wasn’t accuracy. It was where the mistakes

Jev loses to Gemini on email classification benchmark, still considered for production 1
· 438 likesOpen on X