Back to explore

Building an Eval Suite for System One Models like Jev

Morgan shares the experience of building an eval suite for System One models like Jev: the first two attempts failed but taught a lot, and Jev's speed and low cost make quick testing easier than with an LLM.

It has been a really interesting experience to build an eval suite for System One Models like Jev. My first two attempts didn't work out. But I learned a lot in the process, and since Jev is so fast, and cheap, it's a lot easier to run quick tests than with an LLM. I'm on

Building an Eval Suite for System One Models like Jev 1
· 0 likesOpen on X