返回探索

将开源LLM转化为Jev式快速决策模型

介绍如何无需训练,将低成本开源LLM转化为类似Jev的快速决策模型,并解释LLM通过为词汇打分选择下一个词的工作原理。

you can turn any low-cost open-source LLM into a Jev like fast decision model without training it. Here's how to do it: An LLM doesn't write text directly. At every step it scores every word in its vocabulary for how likely that word is to come next, and then it picks one. Those

· 0 次赞在 X 打开