Back to explore

Jev Benchmarked: 50k Passages in 37 Minutes, 9x Faster than Qwen

Developer Steven Denney shares: encoding ~50,000 passages from a North Korean economics journal corpus with Jev and Qwen. Jev finished in 37 minutes for $4.46, 9× faster than Qwen. When Claude Sonnet adjudicated a random sample plus cases with highest model disagreement, it sided mainly with Jev.

I coded ~50,000 passages from a N. Korean economics journal corpus with Jev and Qwen. Jev did it in 37 minutes for $4.46, 9× faster than Qwen. When Claude Sonnet adjudicated a random sample plus the cases where the models disagreed most, it sided mainly with Jev in both cases.

Jev Benchmarked: 50k Passages in 37 Minutes, 9x Faster than Qwen 1
· 1 likesOpen on X