THE JEV GUIDE · CURATED EDITION

Scientific research.

Launch news, explanations, demos, and community projects around TypeSafe Jev, organized by topic. Every entry links back to its X source.

Curated selection · Not exhaustive · Updated manually

6757curated posts
3414original videos

Realtime-Bench: Jev Is Fastest, But Scores Only 8%

Key findings from Realtime-Bench: the best model GPT-6-Astra scores 36%, while Jev answers in under 1 second as the fastest model, scoring 8%. More reasoning helps only when the clock is paused; with a real clock, slow thinking costs the win. Even with time frozen, many tasks remain unsolved.

Video frame from the original post: Realtime-Bench: Jev Is Fastest, But Scores Only 8%

alphaXiv Unveils 4B Decision Model, Compares with Jev

alphaXiv says it trained a 4B model on 117k decision-making examples; it performs nearly identically to Jev except in sarcasm detection, and generalizes to unseen tasks like hate-speech severity.

alphaXiv Unveils 4B Decision Model, Compares with Jev · original post image 1

Decision Bench Results: Jev 1.13 vs Clef Omni

Wasim Jalali shares Day 9 of Decision Bench: Clef Omni ranks last of 8 with 87.2% accuracy, compared to Jev 1.13 on hidden questions and noise handling. It is conservative and leaves most noise in.

Decision Bench Results: Jev 1.13 vs Clef Omni · original post image 1Decision Bench Results: Jev 1.13 vs Clef Omni · original post image 2Decision Bench Results: Jev 1.13 vs Clef Omni · original post image 3

Model beats Jev on guard benchmarks with zero proprietary data

Carlos Muñoz Ferrandis reports that in one week, using two A100s and only open datasets plus synthetic replies, their model beats Jev on 6 of 8 public guard benchmarks, achieves 0.936 mean AUROC vs Jev's 0.934, and runs at 90 ms per request on one A100.

Model beats Jev on guard benchmarks with zero proprietary data · original post image 1

Tencent Paper Compares Jev with Major LLMs

The post cites a Tencent research paper evaluating Jeve's judgment under option order changes, showing Jev often fails even on solvable problems, aligning with the author's experience.

Tencent Paper Compares Jev with Major LLMs · original post image 1

Classifying Robot Modeling Papers with Jev

Ben Kolligs used Jev from @typesafe to classify titles and abstracts of robot modeling papers, finding VLA model papers rose from ~10% in 2023 to 38% in Jan–Sep 2026, and world models from 9% to 18%.

Classifying Robot Modeling Papers with Jev · original post image 1

Study on Jev's Probability Allocation in Multi-Answer Tasks

The post shares a study on model behavior in multi-answer tasks: models can rank correct options before distractors yet still assign low probabilities to some correct items. The paper evaluates Jev and other models on MetaTool, HotpotQA, and ECtHR. Link

Study on Jev's Probability Allocation in Multi-Answer Tasks · original post image 1Study on Jev's Probability Allocation in Multi-Answer Tasks · original post image 2