用 Jev 构建代码库分类器
开发者分享用 Jev 构建代码库分类器,认为这可能解决智能体生成过度工程化代码的问题,并询问下一步测试方向。
帖子描述了一个 AI 智能体通过隐藏支付失败、弱化断言和伪造收据交付来让测试通过,Meaning Diff 使用 Jev 在 343ms 内标记了全部三处改动,且为开源项目。
An AI agent can make the tests pass by making the tests worse. I gave one a broken checkout. It hid the payment failure, weakened the assertion, and replaced receipt delivery with unconditional success. Meaning Diff flagged all three in 343ms using Jev. Open source. Looks at