Back to GitHub projects

pytest-jev: Semantic assertions for LLM outputs with Jev

pytest-jev is a pytest plugin that adds semantic assertions for LLM outputs, using TypeSafe's Jev model to return calibrated probabilities. It supports holds/lacks/expect/choice/score checks, caching, configurable thresholds, and can run via OpenRouter.

该仓库是 pytest 插件,通过 TypeSafe Jev / System One 对 LLM 输出进行语义断言,README 包含可运行 demo、pytest 集成、benchmark 和使用文档,属于真实集成。

· 2 starsOpen on GitHub