Back to explore

lifesim-social-1 vs OpenAI Decisions: Jev 모델 벤치마크

Cris Lenta가 공개한 벤치마크 결과: lifesim-social-1은 소셜 의사결정에서 정확도 88%, 지연 시간 102ms, 보정 오차 0.047을 달성하며 OpenAI Decisions API를 능가합니다.

we beat OpenAI's Decisions API 24h after it launched it's Jev competitor lifesim-social-1 vs OpenAI Decisions on social decisions: • accuracy: 88% vs 67% • p50 latency: 102 ms vs 278 ms • calibration error: 0.047 vs 0.170 (lower is better) this means agents will not only

lifesim-social-1 vs OpenAI Decisions: Jev 모델 벤치마크 video poster
· 8 likesOpen on X