TypeSafe AI Added to Citation Checker Tool
User added @typesafeai to their citation checker and praises it, free to try at PaperTrellis, tagged with Jev and AI in medicine. Link
Model beats Jev on guard benchmarks with zero proprietary data
Carlos Muñoz Ferrandis reports that in one week, using two A100s and only open datasets plus synthetic replies, their model beats Jev on 6 of 8 public guard benchmarks, achieves 0.936 mean AUROC vs Jev's 0.934, and runs at 90 ms per request on one A100.
It took us one week. Two A100s. Zero Alinia data. Only open datasets and synthetic replies. - Beating Jev on 6 of 8 public guard benchmarks. - 0.936 mean AUROC vs Jev’s 0.934 - 90 ms per request on one A100 .
· 0 likesOpen on X
More like this
JevBench: First Benchmark for Jev-Class Models Released
JevBench is the first benchmark for Jev-class models. Original Jev by TypeSafe AI leads at 75.3, with SemIf second at 74.6. Full results at benchmarkheaven.com/jev-models. Link
Jev Completes 100 Consecutive Trolley Problems
The post says someone entrusted their life to Jev and had it complete 100 consecutive trolley problems; in the first round, Jev chose to pull the lever with 99% probability, sacrificing 1 to save 5.
