Building a Codebase Classifier with Jev
A developer shares building a codebase classifier with Jev, suggesting it may solve overengineered code from agents, and asks what to test next.
Using Jev for LLM Evals
Hamel Husain notes Jev can be used for LLM evals since an LLM Judge is essentially a classifier, and advises testing classifiers against human labels and avoiding overfitting.
Can you use Jev for Evals? Yes! Remember that a LLM Judge is also classifier*. Make sure to test your classifiers against human labels and don't overfit. Hope this helps! * https://hamel.dev/blog/posts/evals-faq/why-do-you-recommend-binary-passfail-evaluations-instead-of-1-5-ratings-likert-scales.html…
· 130 likesOpen on X
More like this
Jev Enables LLM-as-a-Judge at 20–200x Speed and 40–400x Lower Cost
Jev was used to pick which model is AGI, offering 20–200x speed and 40–400x lower cost, making LLM-as-a-judge extremely fast and nearly free.
Testing apps with TypeSafe Jev & OpenCode
Filip shares a small demo showing how fast testing apps can be with TypeSafe Jev and OpenCode.
