Back to explore

Jev System Oneモデル、理解テストでGPT-6 AstraとFable 5.1を上回る

Angusが@typesafeaiの新しいJev「System One Model」を28問の理解テストでベンチマーク。Jevは100%の精度と1.0秒でGPT-6 AstraとFable 5.1を上回り、GPT-4o miniを対照として追加。

Benchmarked @typesafeai's new #Jev "System One Model" against GPT-6 Astra and Fable 5.1 on a 28-question comprehension test: 🥇 Jev: 100% accurate, 1.0s 🥈 Astra: 100%, 8.8s 🥉 Fable 5.1: 100%, 10.7s Added GPT-4o mini as a control: 4.1s, but made mistakes. What we building?

· 0 likesOpen on X