Back to explore

Realtime-Bench: Jev Is Fastest, But Scores Only 8%

Key findings from Realtime-Bench: the best model GPT-6-Astra scores 36%, while Jev answers in under 1 second as the fastest model, scoring 8%. More reasoning helps only when the clock is paused; with a real clock, slow thinking costs the win. Even with time frozen, many tasks remain unsolved.

Realtime-Bench ⏱️ Key findings: - Best model (GPT-6-Astra): 36%. - Fastest model (Jev, answers in under 1s): 8%. - More reasoning helps only when the clock is paused. - With a real clock, slow thinking costs the win. - Even with time frozen, many tasks stay unsolved. Play with

Realtime-Bench: Jev Is Fastest, But Scores Only 8% video poster
· 55 likesOpen on X