Building a Codebase Classifier with Jev
A developer shares building a codebase classifier with Jev, suggesting it may solve overengineered code from agents, and asks what to test next.
Braintrust tests Jev as a judge model
Braintrust tested Jev as a judge model: fast, cheap, and competitive for groundedness judging, but behind reasoning models for math and code domains. Recommended for certain eval tasks, not a full replacement for LLM-as-a-judge.
We tested where Jev holds up as a judge. Jev was fast, cheap, and highly competitive for judging groundedness. But it lagged behind models with reasoning for math and code domains. Use it for certain eval tasks, but don't throw out your LLM-as-a-judge just yet. Read more →
· 26 likesOpen on X
More like this
Jev Enables LLM-as-a-Judge at 20–200x Speed and 40–400x Lower Cost
Jev was used to pick which model is AGI, offering 20–200x speed and 40–400x lower cost, making LLM-as-a-judge extremely fast and nearly free.
Testing apps with TypeSafe Jev & OpenCode
Filip shares a small demo showing how fast testing apps can be with TypeSafe Jev and OpenCode.
