返回探索

Jev 以约100ms路由语音智能体每轮决策

开发者分享:语音智能体在 4090 上运行 Qwen3 每轮等待数秒,改用 Jev 做选择/真假/评分决策后,每轮路由约100ms,仅在真正需要推理时才调用 GPU。

Our voice agent runs Qwen3 on a 4090. Every turn waits seconds. Jev can't talk. It only decides: choice, true/false, score. Now Jev routes each turn in ~100ms. The GPU only fires when reasoning is truly needed. We spent months making inference faster. The fix: infer less.

Jev 以约100ms路由语音智能体每轮决策 1
· 0 次赞在 X 打开