Back to explore

Beating OpenRouter's Jev Router on OSS Bug Fixes

This post claims their router outperforms OpenRouter's Jev Router and Auto router on pytest-graded bug fix tasks, with higher consistency (94.4% vs 72.2% vs 16.7%), lower cost per task, and lower latency.

We just beat OpenRouter’s Jev Router and their Auto router on real OSS bug fixes. 18 tasks × 3 attempts, pytest graded: → Consistency: 94.4% vs 72.2% vs 16.7% → Cost/task: $0.000042 vs $0.000135 vs $0.007615 → Latency: faster than both Zero-markup BYOK + smarter routing +

Beating OpenRouter's Jev Router on OSS Bug Fixes 1
· 0 likesOpen on X