Writing C++ with Jev by picking valid next tokens
The author experimented with TypeSafe's Jev decision/classifier model for C++: at each step it was given only grammatically valid next tokens to pick from, avoiding free-form generation.
This post claims their router outperforms OpenRouter's Jev Router and Auto router on pytest-graded bug fix tasks, with higher consistency (94.4% vs 72.2% vs 16.7%), lower cost per task, and lower latency.
We just beat OpenRouter’s Jev Router and their Auto router on real OSS bug fixes. 18 tasks × 3 attempts, pytest graded: → Consistency: 94.4% vs 72.2% vs 16.7% → Cost/task: $0.000042 vs $0.000135 vs $0.007615 → Latency: faster than both Zero-markup BYOK + smarter routing +