Jev versus text-generating models
Jev does not generate free-form text. A side-by-side video compares parallel decision-making with token-by-token text generation.
Jev-style local LLM engine: judgment-only inference in 40ms
Taro L. Saito notes that, like Jev, a local LLM engine achieves 40ms inference by abandoning text/JSON generation and specializing in judgment, running on DGX Spark.
Just like Jev, to think that a Local LLM engine capable of inference in 40ms is realized simply by abandoning text/json generation and specializing solely in judgment. It's running on DGX Spark, but anyway, it's incredibly fast.
· 1.3K likesOpen on X
More like this
Pricing, evaluations, and the name Jev
The launch thread explains code-and-AI workflow evaluations, the input price announced at launch, and free output tokens.
Jev Model: Decision-Making Probability Generation, 200× Faster and 400× Cheaper Than LLMs
This model is built for decision-making rather than text generation, outputting probabilities for each option in parallel instead of token-by-token responses. The author shares a simplified comparison of normal LLMs versus this Jev model.
