Jev beats Gemini 2.5 Flash Lite on classifier eval quality and speed
Malte Ubl ran TypeSafe AI's Jev against an existing classifier eval, where it saturated the eval on quality and was 6x faster than Gemini 2.5 Flash Lite.
Additional Jev HTTP Round-Trip Latency Measurements
A supplementary trial with a measurement screen: median browser round-trip 1,139.7ms, Jev HTTP round-trip 490.3ms, state fetch to action 1,139.8ms; HTTP round-trip includes network time, not pure inference speed, and latency vs. action-decision effects are still being isolated.
計測画面付きの別試行も補足します（成功3応答）。 中央値： ・ブラウザ往復 1,139.7ms ・Jev HTTP往復 490.3ms ・状態取得→操作 1,139.8ms 今回も最初の敵に接触。HTTP往復には通信時間が含まれ、純粋な推論速度ではありません。遅延と操作判断の影響は引き続き切り分け中です。
· 0 likesOpen on X
More like this
Fast row classification in DuckDB with Jev
The author released a DuckDB extension that uses TypeSafe AI's Jev to quickly classify rows in CSV/Parquet files or DuckDB tables, taking about 10 seconds for 1k rows—faster than an LLM and more ergonomic than a classifier.
Classifying 1,018 AI Papers with Jev for $0.08
The author summarized each paper with DeepSeek V4 Flash, then sent the title, summary, and 24 candidate topics to Jev for classification, processing 1,018 AI papers at $0.08 total cost and 256ms median end-to-end latency per paper.
