Back to explore

オープンソースLLMをJevのような高速意思決定モデルに変換

低コストのオープンソースLLMを訓練なしでJevのような高速意思決定モデルに変換する方法と、LLMが語彙をスコアリングして次の単語を選ぶ仕組みを解説。

you can turn any low-cost open-source LLM into a Jev like fast decision model without training it. Here's how to do it: An LLM doesn't write text directly. At every step it scores every word in its vocabulary for how likely that word is to come next, and then it picks one. Those

· 0 likesOpen on X