Writing C++ with Jev by picking valid next tokens
The author experimented with TypeSafe's Jev decision/classifier model for C++: at each step it was given only grammatically valid next tokens to pick from, avoiding free-form generation.
In one coding task, four key changes deliver major cost savings: smarter notes selection saves 23.7%, moving decisions to Jev saves 51.2%, proper recovery paths save 58.1%, and routing to a fast worker saves 68.8%. Each lever stacks on the last, cutting cost from $6.42 to $2.00.
4 changes. Here's what each one saved on the same coding task: Smarter notes selection → 23.7% Decisions moved to Jev → 51.2% Proper recovery paths → 58.1% Routing to a fast worker → 68.8% $6.42 per task → $2.00. Each lever stacks on the last. Start with number 1 today.