Back to explore

Turn Open-Source LLMs into Jev-like Fast Decision Models

Explains how to turn low-cost open-source LLMs into Jev-like fast decision models without training, and how LLMs score vocabulary to pick the next word.

you can turn any low-cost open-source LLM into a Jev like fast decision model without training it. Here's how to do it: An LLM doesn't write text directly. At every step it scores every word in its vocabulary for how likely that word is to come next, and then it picks one. Those

· 0 likesOpen on X