pytest-jev: Semantic assertions for LLM outputs with Jev
pytest-jev is a pytest plugin that adds semantic assertions for LLM outputs, using TypeSafe's Jev model to return calibrated probabilities. It supports holds/lacks/expect/choice/score checks, caching, configurable thresholds, and can run via OpenRouter.