Back to explore

OneCodeReviewBench: Jev vs. hosted decision APIs on code review decisions

Mohebifar's team released OneCodeReviewBench, with ~2,000 typed code review and search decisions across 12 languages. The finding is that Jared Palmer's 27B model Kev outperformed Jev and other hosted decision APIs on choice and score questions.

We just put out OneCodeReviewBench: ~2000 typed code review + search decisions across 12 languages. Fun finding: @jaredpalmer 's 27B (Kev) beat Jev and other hosted decision APIs in choice and score questions! https://arxiv.org/abs/2610.33389

OneCodeReviewBench: Jev vs. hosted decision APIs on code review decisions 1
· 3 likesOpen on X