Writing C++ with Jev by picking valid next tokens
The author experimented with TypeSafe's Jev decision/classifier model for C++: at each step it was given only grammatically valid next tokens to pick from, avoiding free-form generation.
When working with a decision model like Jev, don't make another AI call just because your code took a different branch. Ask more questions all at once.
That's the paradigm shift you have to think about when working with a decision model like Jev. Don't make another AI call just because your code took a different branch. You have to ask more questions, all at once...