Building a Codebase Classifier with Jev
A developer shares building a codebase classifier with Jev, suggesting it may solve overengineered code from agents, and asks what to test next.
The author ran a toy pipeline decomposing text-based rubrics into structured answers to compare Jev and Codex Luna as graders on FrontierCode-style code taste tasks.
ran a toy pipeline comparing jev vs codex luna as graders on FrontierCode style "code taste" tasks: decomposed text-based rubrics into structured answers (e.g. are all changes necessary? do all changes consistently use the abstractions required by the task?) -> run both models in