返回探索

Jev 开源版:单次前向传播回答类型化问题

作者在 Spark 上于 LLM 旁部署第二个模型,它不生成文本,而是接收状态和类型化问题,在单次前向传播中给出每个问题的概率答案;这是 Jev 的开源版本,可安装在 macOS 及 Nvidia 设备上。

I put a second model next to the LLM on my Spark. It does not write text. You send it a state and typed questions, and it answers every one of them in a single forward pass, each with a probability. Yes it is Jev the open source version. It can be installed on macOS, any Nvidia

· 35 次赞在 X 打开