Building a Codebase Classifier with Jev
A developer shares building a codebase classifier with Jev, suggesting it may solve overengineered code from agents, and asks what to test next.
Josh notes that Jev performs well in zero-shot classification, but specialist classifiers are more advantageous in commercial settings. He mentions @trycua tuned a tiny model scoring 99.7% on form-filling eval, while hosted Jev scored 83.6%, and shares his experience tuning GLiNER 2.5 in 51 minutes.
Jev is great at zero-shot classification, but specialist classifiers will dominate commercial use cases. @trycua tuned a tiny model that scored 99.7% on their form-filling eval. Hosted Jev scored 83.6%. I tuned GLiNER 2.5 on a task in 51 minutes yesterday and it crushes