Building a Codebase Classifier with Jev
A developer shares building a codebase classifier with Jev, suggesting it may solve overengineered code from agents, and asks what to test next.
Jev 1.13.0 Benchmark: Close to Winnow-12B
Benchmark Heaven's comparison shows Jev 1.13.0 nearly level with Winnow-12B Q8 in public accuracy and cost, with Jev leading in calibration and score.
Winnow-12B Q8 (#4) and Jev 1.13.0 (#1) are nearly level on public accuracy, 85.7% vs 86.6%, and on Cost, 52.9 vs 52.0. The gap is confidence. Calibration 64.8 vs 76.3; sealed set 33.1% vs 36.7%. Score 55.58 vs 63.29. https://benchmarkheaven.com/jev-models/v1.4.1?compare=jev-1.13.0,winnow-12b…
· 0 likesOpen on X
More like this
Jev Enables LLM-as-a-Judge at 20–200x Speed and 40–400x Lower Cost
Jev was used to pick which model is AGI, offering 20–200x speed and 40–400x lower cost, making LLM-as-a-judge extremely fast and nearly free.
Testing apps with TypeSafe Jev & OpenCode
Filip shares a small demo showing how fast testing apps can be with TypeSafe Jev and OpenCode.
