Back to explore

Jev open source: answering typed questions in a single forward pass

The author runs a second model alongside the LLM on a Spark. It does not write text; it takes a state and typed questions and answers each in a single forward pass with a probability. This is the open source version of Jev, installable on macOS and Nvidia hardware.

I put a second model next to the LLM on my Spark. It does not write text. You send it a state and typed questions, and it answers every one of them in a single forward pass, each with a probability. Yes it is Jev the open source version. It can be installed on macOS, any Nvidia

· 35 likesOpen on X