TypeSafe AI Added to Citation Checker Tool
User added @typesafeai to their citation checker and praises it, free to try at PaperTrellis, tagged with Jev and AI in medicine. Link
Jev falls behind frontier LLMs on hard cases
Independent tests show Jev ties LLMs on safety classification and tool routing but lags on open-ended tasks.
4/ The catch: they lose on hard cases. In one benchmark Jev scored 72.5% vs 84% for a frontier LLM. An independent test found decision models tie LLMs on safety classification and tool routing, and fall behind on open-ended tasks.
· 0 likesOpen on X
More like this
JevBench: First Benchmark for Jev-Class Models Released
JevBench is the first benchmark for Jev-class models. Original Jev by TypeSafe AI leads at 75.3, with SemIf second at 74.6. Full results at benchmarkheaven.com/jev-models. Link
Jev Completes 100 Consecutive Trolley Problems
The post says someone entrusted their life to Jev and had it complete 100 consecutive trolley problems; in the first round, Jev chose to pull the lever with 99% probability, sacrificing 1 to save 5.
