用 Jev 构建代码库分类器
开发者分享用 Jev 构建代码库分类器,认为这可能解决智能体生成过度工程化代码的问题,并询问下一步测试方向。
开发者 Chris Dukes 表示 TypeSafe 的 Jev 分类器效果很好,适合在推理时路由到多个同时服务的模型,但受限于 8GB 显存。
Major shoutout to @typesafeai ; #Jev the #classifier works a treat, and is going to be great to route to multiple models served at once when it comes inference time... ...or at least, that would be my PROPER use-case if I wasn't kneecapped at 8GB VRAM 🥲🥲 many thanks for the